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EXECUTIVE  SUMMARY 


This  work  was  supported  by  the  U.S.  Army  Research  Laboratory,  Human  Engineering  and 
Research  Directorate  (HRED)  under  the  auspices  of  the  Human  Systems  Information  Analysis  Center 
(HSIAC)  Program  Office,  Contract  No.  SP0700-98-D-4001;  Task  No.  8027. 

This  effort  was  designed  to  determine  the  status  and  availability  of  alternative  controls  and 
displays  for  implementation  within  Army  ground-based  and  airborne  systems.  To  that  end,  it 
provides  a  broad  baseline  of  information  on  speech-based/auditory,  eye-  and  head-based, 
gesture/tactile,  and  biopotential  technologies.  Where  the  literature  was  lacking,  subject-matter 
experts  were  contacted  to  determine  technology  status  and  assess  its  relevance  to  the  improvement  of 
soldier  performance. 

An  Alternative  Control  and  Display  Technology  Matrix  was  developed  to  compile  and 
summarize  the  subject  matter  expert/source  survey  results.  This  matrix  contains  technology 
descriptions,  point  of  contact  and/or  web  source  information,  estimated  technology 
maturity/availability  level,  and  perceived  benefits  to  the  warfighter  as  stated  in  the  technology 
description  or  subject  matter  contact  results.  In  addition,  web  sites,  papers,  or  other  sources  identified 
that  may  be  of  interest  for  further  independent  investigation  are  listed. 

With  alternative  controls  and  displays  the  steps  from  intention-to-action-to-feedback  will 
typically  be  shortened  and  more  direct.  In  fact,  the  distinction  between  controls  and  displays  is 
becoming  increasingly  artificial.  The  same  device  may  have  both  a  control  and  a  display  function, 
and  they  may  have  to  work  together  synergistically  to  aid  user  performance.  Some  future 
technologies  may  be  so  transparent  in  their  design  or  application  as  to  not  be  consciously  perceived, 
but  merely  regarded  as  aspects  of  normal  "conversation"  with  the  system. 

Of  the  more  mature  alternatives,  Automatic  Speech  Recognition  (ASR)  and  head-based 
technologies  are  both  in  operational  and  experimental  use,  depending  upon  the  level  of  sophistication 
of  the  technology.  Both  are  technically  mature  enough  now  for  full  operational  use,  with  research  on 
the  next  generation,  higher  capability,  systems  in  progress. 

Eye-based  control  is  laboratory  mature  and  used  for  assessing  eye  movement  in  simulators, 
and  with  further  development,  has  the  potential  to  integrate  effectively  in  the  operational 
environment  with  head-  and  voice-based  control.  It  may  enable  a  range  of  potentially  useful  explicit 
and  implicit  control  functions.  The  technology  is  not  yet  mature  enough  for  the  full  operational 
environment,  but  the  necessary  advances  can  probably  be  made  in  the  near  (two  to  four  yrs)  to 
midterm  (four  to  seven  yrs).  Gesture-  and  biopotential-based  (EEG,  EMG)  technologies  are  the  least 
mature.  Application  of  these  technologies  is  just  beginning  in  the  commercial  entertainment 
environment,  but  they  provide  much  potential  for  future  generations  of  Army  systems  (2020). 

Virtual  retinal  displays  (VRD),  tactile  vests,  and  volumetric  displays  are  also  discussed. 
VRDs  and  tactile  vests  are  somewhat  mature  technologies  being  implemented  in  a  limited  fashion  or 
being  demonstrated  operationally  within  the  Department  of  Defense  (DoD).  Volumetric  displays 
appear  useful  in  presenting  large  volumes  of  three-dimensional  data  for  Command  and  Control  (C^), 
but  have  limitations  that  currently  prevent  their  effective  use  in  Army  ground-based  and  airborne 
crew  stations. 

It  appears  a  noticeable  amount  of  work  remains  to  be  done  by  researchers  and  engineers  both 
in  the  human  factors  and  engineering  domains  to  prove  and  provide  the  benefits  that  might  be  gained 
by  integrating  alternative  technologies  into  future  crew  station  environments.  Achieving  a 
meaningful  and  intelligent  implementation  of  these  technologies  will  require  a  synergistic  effort 
involving  research  labs,  system  manufacturers,  and  equipment  makers. 


TABLE  OF  CONTENTS 


1.  INTRODUCTION . 1 

1.1  Background . 1 

1.2  Piupose . ^ 

1.3  Scope . ^ 

1 .4  Overview . ^ 

2.  METHOD . 2 

3  RESULTS  ^ 

3.1  RATIONALE  FOR  ALTERNATIVE  CONTROL/DISPLAY  TECHNOLOGIES  3 

3.1.1  Definition . 3 

3.1.2  Paradigms . 3 

3. 1.2.1  Substitution . 3 

3. 1.2.2  Supplemental . 3 

3. 1.2.3  Transparent  Interface . 4 

3.1 .2.4  Intelligent  Interface . 4 

3.2  TECHNOLOGY  DESCRIPTIONS . 4 

3.2.1  Speech-based/Auditory  Technologies . 4 

3.2. 1.1  Automatic  Speech  Recognition  (ASR) . 4 

3. 2. 1.2  Three-dimensional  (3D)  Acoustic  Display . 6 

3.2. 1.3  Design  Methods  and  Principles . 6 

3. 2. 1.4  Future  Research  and  Development . 7 

3.2.2  Eye-  and  Head-based  Technologies . 7 

3.2.2. 1  Design  Methods  and  Principles . 9 

3.2.2.2  Future  Research  and  Development . 9 

3.2.3  Gesture/Tactile  Technologies . 10 

3.2.3. 1  Design  Methods  and  Principles . 1 1 

3.2.3.2  Future  Research  and  Development . 1 1 

3.2.4  Biopotential  Technologies . 12 

3.2.4. 1  Electromyographic  (EMG)-based . 12 

3. 2.4.2  Electroencephalographic  (EEG)-based  Control . 12 

3.2.4.3  Current  Applications  and  Evaluations . 12 

3.2.4.4  Future  Research  and  Development . 13 

3.2.5  Other  Technologies  of  Interest . 13 

3.2.5. 1  Virtual  Retinal  Display  (VRD) . 13 

3.2.5.2  Tactile  Vests . 14 

3.2.5.3  Volumetric  Displays . 15 

3.3  EXPECTED  BENEFITS . 15 

3.3.1  Redundancy  and  alternative  solutions . 16 

3.3.2  Training  considerations . 17 

3.4  SURVEY  RESULTS . 17 

4.  CONCLUSIONS . 22 

5.  REFERENCES . 24 

6.  ADDITIONAL  READINGS  OF  INTEREST . 26 


IV 


7.  APPENDIX  A:  Literature  search  strategy . A-1 

8.  APPENDIX  B:  Alternative  control  and  display  technology  matrix . B-1 

9.  APPENDIX  C:  Noncopyrighted  search  results . C-1 


V 


FIGURES 


Figure  1.  Subdivisions  used  to  classify  ASR  systems . 5 

Figure  2.  Different  speech  recognition  tasks  shown  in  a  two-dimensional  space . 5 


TABLES 

Table  1.  Performance  parameters,  strengths  and  weaknesses  of  eye-/head-based  technologies  ..8 

Table  2.  Glove-based  technology  characteristics . 10 

Table  3.  Compliance  of  alternative  technology  with  various  system  and  environmental 

criteria . 1^ 

Table  4.  Compliance  of  alternative  technology  with  various  operator  use  criteria . 16 


ACKNOWLEDGMENTS 


This  work  was  supported  by  the  U.S.  Army  Research  Laboratory,  Human  Engineering  and 
Research  Directorate  (HRED)  under  the  auspices  of  the  Human  Systems  Information  Analysis  Center 
(HSIAC)  Program  Office,  Contract  No.  SP0700-98-D-4001;  Task  No.  8027.  HSIAC  would  like  to 
thank  and  acknowledge  Mr.  Paul  H.  Cunningham  as  Program  Manager  and  the  contributions  of  Dr. 
Joe  McDaniel  (AFRL/HECI;  HSIAC  COTR),  Dr.  Michael  Fineherg  (HSIAC  Chief  Scientist),  and 
RoseAnn  Venis  (Technical  Editor)  during  the  review  process.  In  addition,  Judith  Hecht  provided 
excellent  support  in  conducting  the  required  commercial  and  government  literature  searches  for  this 
project. 


NOTICE 

This  report  comprises  two  volumes.  Volume  I  (HSIAC-RA-200 1-001)  is  the  final  report  on 
alternative  controls  and  displays,  accompanying  appendices  and  noncopyrighted  literature  search 
results.  Volume  II  (HSIAC-RA-200 1-002)  contains  pertinent  copyrighted  citations  extracted  from 
commercial  databases. 


DISCLAIMER 

The  views,  opinions,  and/or  findings  contained  in  this  report  are  those  of  the  authors  and  should  not 
be  construed  as  an  official  Department  of  the  Army  position,  policy,  or  decision,  unless  so  designated 

by  other  documentation. 


ACRONYMS 


3D 

Three-dimensional 

ARL 

ASR 

Army  Research  Laboratory 

Automatic  Speech  Recognition 

CTF 

Command  and  Control 

Contrast  Transfer  Function 

DHM 

DoD 

DROLS 

DTIC 

Dexterous  HandMaster™ 

Department  of  Defense 

Defense  RDT&E  On-line  System 

Defense  Technical  Information  Center 

EEC 

EMG 

Electroencephalographic 

Electromyographic 

HFE 

HITL 

HMDs 

HOTAS 

HPS 

HRED 

HSIAC 

Human  Factors  Engineering 

Human  Interface  Technology  Laboratory 
Helmet  Mounted  Displays 

Hands  On  Throttle  And  Stick 

Head  Pointing  Tracker  Systems 

Human  Research  and  Engineering  Directorate 
Human  Systems  Information  Analysis  Center 

IPE 

Individual  Protective  Equipment 

LOS 

Line-of-sight 

NASA 

NAMRL 

NATO 

National  Aeronautics  and  Space  Administration 
Naval  Aerospace  Medical  Research  Laboratory 
North  Atlantic  Treaty  Organization 

R&A 

R&D 

RTO 

Review  &  Analysis 

Research  &  Development 

Research  and  Technology  Organization 

SME 

Subject  Matter  Expert 

TAG 

TSAS 

Technical  Area  Group 

Tactile  Situational  Awareness  System 

USAARL 

U.S.  Army  Aeromedical  Research  Laboratory 

VRD 

Virtual  Retinal  Display 

1.  INTRODUCTION 


1.1  BACKGROUND 

This  Human  Systems  Information  Analysis  Center  (HSIAC)  Review  &  Analysis  (R&A) 
provides  support  to  the  Human  Research  and  Engineering  Directorate  (HRED)  of  the  U.S.  Army 
Research  Laboratory  (ARE)  and  addresses  human  systems  integration  research  associated  with 
alternative  information  processing  controls  and  displays  that  might  be  suitable  for  use  in  future  Army 
ground-based  and  airborne  crewstations. 

The  integration  of  advanced  technologies  into  Army  ground-based  and  airborne  systems  has 
the  potential  for  making  soldier  operation  of  these  systems  more  efficient  and  effective,  as  well  as 
providing  the  soldier  with  greater  situational  awareness  at  lower  levels  of  cognitive  workload.  Some 
of  these  technologies,  known  as  alternative  control  and  display  technologies,  involve  the  aiding  or 
augmenting  of  information  to  and  from  the  soldier  by  nontraditional  modalities  so  they  can  respond 
more  quickly  to  the  demands  of  the  battlefield. 

1.2  PURPOSE 

ARL-HRED  performs  research  exploring  the  integration  of  advanced  information 
technologies  within  Army  crew  stations.  However,  ARL-HRED  needs  to  be  appraised  of  alternative 
control  and  display  technologies  and  identify  when  they  might  be  available  for  test  and  integration 
activities.  Therefore,  this  effort  is  designed  to  provide  an  overview  of  the  alternative  control  and 
display  research  literature  to  include  (1)  technology  descriptions,  (2)  assessments  of  advantages  and 
disadvantages  those  technologies  may  provide  to  Army  systems,  and  (3)  estimates  of  technology 
availability  and  maturity  for  operational  use. 

1.3  SCOPE 

This  effort  has  been  designed  to  determine  the  status  and  availability  of  alternative  controls 
and  displays  for  implementation  within  Army  ground-based  and  airborne  crew  stations.  To  that  end, 
this  investigation  provides  a  broad  baseline  of  information  on  speech-based/auditory,  eye-  and  head- 
based,  gesture/tactile,  and  biopotential  technologies.  Where  the  literature  was  lacking  and  within 
time  and  budgetary  constraints,  subject-matter  experts  were  contacted  to  determine  technology  status 
and  assess  its  relevance  to  the  improvement  of  soldier  performance. 

1.4  OVERVIEW 

A  brief  description  of  the  research  method  used  to  identify  and  analyze  alternative  control 
and  display  technology  information  is  provided  in  Section  2,  METHOD.  The  relevant  findings  are 
presented  in  Section  3,  RESULTS.  Within  Section  3,  the  findings  are  organized  as  follows: 

Section  3.1  RATIONALE  FOR  ALTERNATIVE  CONTROL/DISPLAY  TECHNOLOGIES 

Section  3.2  TECHNOLOGY  DESCRIPTIONS 

Section  3.3  EXPECTED  BENEFITS 

Section  3.4  SURVEY  RESULTS 

Section  4,  CONCLUSIONS,  is  followed  by  references,  recommended  readings  and  appendices 
containing  additional  detailed  information. 
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2.  METHOD 


A  keyword  list  and  search  strategy  (Appendix  A)  was  developed  and  a  search  of  both 
government  and  commercial  literature  databases  was  conducted  to  identify  relevant  information.  The 
search  strategy  was  employed  by  professional  database  researchers  using  the  following  in-house, 
government  and  commercial  databases: 

•  Aerospace  Database 

•  Applied  Science  and  Technology  Abstracts  (1983-Present) 

•  Defense  Technical  Information  Center  (DTIC)  Defense  RDT&E  On-line  System 
(DROLS) 

o  Research  Simunaries 
o  Technical  Reports 

•  Dissertation  Abstracts 

•  Ei  Compendex  (1980-Present) 

•  Human  Systems  Information  Analysis  Center  (HSIAC)  Document  Database 

•  U.S.  Patents  (1990-Present) 

Search  results  produced  over  1 100  citations  and  abstracts,  some  of  which  were  unrelated  to 
the  specific  objectives  of  this  effort.  The  abstracts  were  reviewed  by  HSIAC  analysts  to  identify  the 
most  pertinent  and  selected  documents  were  obtained  to  use  as  source  material  in  the  preparation  of 
this  report. 

Sections  3. 1-3.3  of  this  report  rely  especially  heavily  on  material  drawn  from  a  chapter  on 
Nonconventional  Controls  by  McMillan,  Eggleston,  and  Anderson  (1997)  in  the  Handbook  of 
Human  Factors  and  Ergonomics  (Salvendy,  1997)  and  a  NATO  Research  and  Technology 
Organization  (RTO)  report  (NATO,  1998)  entitled  Alternative  Control  Technologies:  Human 
Factors  Issues  assembled  to  support  a  Working  Group  25  Lecture  Series  under  the  sponsorship  of  the 
Human  Factors  and  Medicine  Panel.  These  documents  provide  excellent  technology  summaries  and 
succinctly  address  the  human  factors  and  engineering  implications  of  incorporating  advanced, 
alternative  controls  and  displays  into  warfighter  crew  stations. 

An  internet  search  was  also  conducted  and  key  subject-matter  experts  were  identified  and 
contacted  to  capture  commercial,  academic,  and  laboratory  research  and  development  efforts  not  yet 
published  in  the  open  literature.  Further,  members  of  the  Controls  and  DisplaysWoice  Interactive 
Systems  Human  Factors  Engineering  (HFE)  SubTAG  (Technical  Area  Group)  were  contacted  and 
asked  to  provide  input  regarding  ongoing  research  and  development  in  the  area  of  alternative  controls 
and  displays.  Results  of  this  effort  are  documented  in  Section  3.4,  SURVEY  RESULTS,  and 
supported  the  development  of  the  Alternative  Control  and  Display  Technology  Matrix  found  in 
Appendix  B.  Relevant  citations  extracted  from  non-copyrighted  literature  databases  are  found  in 
Appendix  C. 


2 


3.  RESULTS 


3.1  RATIONALE  FOR  ALTERNATIVE  CONTROL/DISPLAY  TECHNOLOGIES 

Future  Army  crew  systems  will  inevitably  incorporate  more  complex  technologies  to  cope 
with  increasingly  demanding  operational  scenarios.  As  crew  system  capabilities  continue  to  increase 
through  the  use  of  more  sophisticated  sensors  and  software,  there  will  need  to  be  an  equivalent 
advance  in  the  way  the  warfighter  interfaces  with  the  systems  to  enable  efficient  information 
exchange  and  control  between  the  operator  and  future  generations  of  Army  ground-based  and 
airborne  crew  stations. 

Physically  and  cognitively  demanding  operations  in  the  current  generation  of  fixed  and 
rotary  wing  aircraft,  particularly  at  night  and  in  poor  weather,  have  increased  the  need  for  more 
"eyes-out"  operations,  reducing  the  time  for  assimilation  of  information  from  head  down 
displays/controls.  Progress  has  been  made  toward  the  assimilation  of  visual  display  data  through 
Helmet  Mounted  Displays  (HMDs)  and  time  reductions  in  switching  operations  have  been  achieved 
by  the  use  of  the  Hands  On  Throttle  And  Stick  (HOT AS)  concept — ensuring  that  the  pilot  has  no 
need  to  move  his  or  her  hands  from  the  primary  aircraft  controls  during  high  workload  periods. 
However,  next  generation  Army  crew  stations  aspire  toward  implementing  alternative  control  and 
display  technologies  to  provide  a  more  natural  interface  between  the  operator  and  the  system 
(NATO,  1998).  The  following  sections  will  define  and  describe  some  of  these  alternative 
technologies  and  their  method  and  suitability  for  implementation  in  the  operational  environment. 

3.1.1  Definition 

Alternative  information  control  and  display  technologies  may  be  regarded  as  any  concept 
that  has  not  been  commercialized  or  gained  wide  acceptance  in  the  military  operational  environment. 
However,  McMillan  et  al.  (1997)  define  them  as  technologies  ". .  .that  do  not  require  a  direct 
mechanical  linkage  between  the  user  and  the  input  device"  (p.730).  Therefore,  with  alternative 
controls  and  displays  the  steps  from  intention-to-action-to-feedback  will  typically  be  shortened  and 
more  direct.  In  fact,  the  distinction  between  controls  and  displays  is  becoming  increasingly  artificial. 
The  same  device  may  have  both  a  control  and  a  display  function,  and  they  may  have  to  work  together 
synergistically  to  aid  user  performance.  Some  future  technologies  may  be  so  transparent  in  their 
design  or  application  as  to  not  be  consciously  perceived,  but  merely  regarded  as  aspects  of  normal 
"conversation"  with  the  system. 

3.1.2  Paradigms 

The  following  sections  provide  some  understanding  of  the  interface  design  paradigms  used  to 
structure  and  guide  alternative  control  and  display  research,  development  and  implementation. 

3.1.2.1  Substitution 

The  most  straightforward  path  of  alternative  technology  insertion  is  to  replace  a  conventional 
control  or  display  device  with  a  nonconventional  one.  Within  this  paradigm,  the  goals  for  the  new 
device  remain  unchanged  from  the  original  ones,  only  the  method  of  implementation  is  changed. 

3.1. 2.2  Supplemental 

Another  interface  development  paradigm  involves  adding  alternative  technologies  to  provide 
additional  control  or  display  paths  for  the  user  when,  for  example,  a  new  task  is  being  introduced. 
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These  technologies  may  be  integrated  with  conventional  controls  to  increase  their  range  of 
functionality  or  be  used  as  backup  devices  for  built-in  redundancy  in  case  of  primary  control/display 
failure  or  during  periods  of  peak  operational  workload. 

3. 1.2.3  Transparent  Interface 

Alternative  technologies  that  support  direct  manipulation  of  system  elements  by  the 
warfighter  to  accomplish  a  task  may  be  referred  to  as  "transparent"  in  nature.  A  transparent  interface 
develops  when  the  line  between  control  and  display  becomes  "blurred"  and  is  no  longer  apparent  to 
the  operator. 

3.1.2.4  Intelligent  Interface 

An  intelligent  interface  is  one  that  can  interact  with  the  user  at  the  knowledge  level 
(McMillan  et  al.,  1997).  Abstract  commands,  interpreted  in  a  context  sensitive  manner  by  the 
interface,  exercise  ultimate  control  for  lower  level  actions.  In  this  case,  control  and  display  actions 
will  not  be  directly  manipulated  by  the  user,  but  may  instead  be  inferred  or  interpreted  by  the  system 
based  on  operator  actions  and  the  corresponding  sensor  input  from  the  operational  environment. 

3.2  TECHNOLOGY  DESCRIPTIONS 

The  following  sections  contain  a  high-level  review  of  the  alternative  technologies  most 
frequently  cited  as  showing  promise  for  implementation  in  the  military  operational  environment. 

3.2.1  Speech-Based/Auditory  Technologies 

Speech-based/auditory  technologies  are  the  most  mature  technologies  discussed  in  the 
literature  and  probably  represent  the  lowest  risk  alternatives  for  system  control  and  information 
display.'  With  the  use  of  voice  command  as  control  input  to  the  system,  the  problem  of  memorizing 
switch  or  button  positions  in  a  HOTAS  paradigm  is  reduced,  with  only  the  lesser  problem  of 
remembering  the  flmctions  remaining.  In  practice  this  reduction  in  memory  demand  should 
significantly  reduce  errors,  especially  during  periods  of  peak  workload.  Due  to  the  remaining 
limitations  in  the  technology,  however,  and  the  expectations  of  users  for  highly  accurate,  robust,  and 
reliable  systems,  applications  of  this  technology  in  the  military  operational  environment  are  only 
recently  becoming  more  widespread.  Research  work  is  now  taking  place  for  the  next  generation  of 
systems. 

3.2.1.1  Automatic  Speech  Recognition  (ASR) 

ASR  systems  map  an  input  speech  waveform  to  its  corresponding  text  as  stored  in  the  system 
database.  While  a  wide  variety  of  specific  components  and  processes  have  been  used,  all  ASR 
systems  consist  of  combinations  of  the  following: 

•  Signal  acquisition — ^microphones  of  various  styles  and  frequency  responses. 

•  Signal  processing — digital  signal  processing  algorithms  that  identify  or  quantify  the  speech 

signal. 


'  It  may  be  argued  that  eye-/head-based  technologies  are  already  implemented  in  many  operational  military  crew 
stations.  Therefore,  they  represent  a  more  mature  technology.  However,  speech-based/audio  technologies  are 
commercially  available  and  implemented  across  a  wider  variety  of  applications. 
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•  Pattern  matching — algorithms  that  transform  the  processed  speech  into  a  text  string  of  the 
recognized  speech. 

•  Feedback — visual  or  auditory  changes  in  the  display  or  system  status  that  indicate  a  control 
command  was  received  and  implemented  as  intended. 


ASR  systems  are  often  subdivided  into  classes  according  to  the  problems  they  address 
(Figure  1).  The  first  subdivision  is  based  on  number  of  speakers  a  system  will  recognize.  Speaker- 
dependent  systems  generally  recognize  speech 
from  only  the  speaker  that  "trained"  the  system. 

Speaker-independent  systems  recognize  speech 
from  many  speakers. 

The  next  subdivision  is  based  on  how 
the  system  handles  word  boundaries.  Isolated 
word  systems  require  a  100-250  millisecond 
pause  between  spoken  words  for  accurate 
recognition.  Connected  word  recognition 
systems  require  a  very  short  (<100  millisecond) 
pause  between  words.  Continuous  speech 
recognition  systems  require  no  pause  between 
words  and  can  generally  accept  fluent  (i.e., 
conversational)  speech. 

Finally,  a  subdivision  is  based  on 
the  size  of  the  vocabulary  that  the  system  Figure  1 .  Subdivisions  used  to  classify  ASR 

is  able  to  recognize:  small  (<  200  words),  systems 

large  (1000  -5000  words),  very  large 

(5000  words  or  greater)  or  unlimited  (>  64,000  words).  Speech  recognition  performance  for  small 
and  large  vocabulary  systems  is  generally  adequate  for  benign  (i.e.,  quiet  office)  environments. 
However,  dramatic  changes  in  the  acoustic  environment  are  likely  to  cause  a  degradation  in  system 
performance. 

The  answer  to  which  combination  of  the  above  characteristics  is  best  depends  on  the 
particular  application  and  the  characteristics  of  the  user,  task,  and  environment.  Figure  2  is  a  decision 
guide,  helpful  for  evaluating  the  best  combination  of  characteristics. 


2  20  200  2000  20000  Unlimited 


SIZE  OF  VOCABULARY 
(Number  of  Words) 

Figure  2.  Different  speech  recognition  tasks  shown  in  a  two-dimensional  space:  speaking  style 
and  vocabulary  size.  (McMillan  et  al.,1997;  as  adapted  from  Atal,  1994) 
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Applications  that  can  be  accomplished  with  current  technology  are  shown  to  the  left  of  the 
dotted  line,  while  applications  to  the  right  require  additional  research  and  development  before  they 
will  be  practical  for  operational  environments. 

3.2.1. 2  Three-dimensional  (3D)  Acoustic  Display 

Attention  has  been  devoted  to  the  use  of  nonspeech  audio  as  an  interface  medium  since 
auditory  signals  are  detected  more  quickly  than  visual  signals  and  tend  to  produce  an  alerting  or 
orienting  response  (e.g.,  cockpit  alerts,  warnings,  and  cautions).  The  three-dimensional  (3D) 
acoustic  display  is  a  means  for  accurately  transferring  information  to  an  operator  using  the  auditory 
modality;  it  combines  directional  and  semantic  characteristics  to  form  naturalistic  representations  of 
objects  and  events  in  remotely-sensed  or  simulated  environments  (Wenzel,  1991). 

A  3D  auditory  display  may  be  most  usefully  applied  in  contexts  where  the  representation  of 
spatial  information  is  important,  particularly  when  visual  cues  are  limited  or  absent  and  workload  is 
high.  Such  displays  can  potentially  enhance  information  transfer  by  combining  directional  with 
iconic  information  to  represent  dynamic  objects  in  the  interface.  Although  the  technology  could 
likely  stand  alone  in  some  applications,  it  is  primarily  envisioned  as  a  component  of  a  larger 
multisensory  (e.g.,  visual,  tactile,  auditory)  environment. 

3.2.1. 3  Design  Methods  and  Principles 

McMillan  et  al.  (1997,  p.  738;  as  adapted  from  Simpson,  McCauley,  Roland,  Ruth,  & 
Williges,  1987)  and  Wenzel  (1991,  p.  4)  present  the  following  general  design  guidelines  for  ASR 
and  3D  acoustic  display  systems  that  may  be  valuable  for  ARL/HRED  researchers  investigating  the 
implementation  of  these  technologies  into  current  and  future  Army  crew  stations; 

1 .  When  using  speech-based  control,  expect  the  greatest  payoff  in  task  performance  speed 
and  accuracy  for  complex  information  entry  tasks  that  must  be  performed  in  conjunction 
with  other  manual  or  visual  tasks. 

2.  The  selection  of  speech-based  control  should  be  based  on  an  analysis  of  the  application 
task  requirements.  When  designing  the  vocabulary  for  the  recognition  system,  use 
terminology  that  is  familiar  to  the  users  and  avoid  the  use  of  acoustically  similar  words. 

3.  Users  should  be  trained  to  improve  their  pronunciation  and  microphone  usage  when 
possible. 

4.  Performance  of  the  human-machine  system  should  be  measured  in  terms  of  operationally 
relevant  measures  such  as  system  response  time,  system  accuracy,  and  user  acceptance. 

5.  Feedback  should  be  provided  so  that  the  user  is  aware  of  the  recognition  results  or  the 
system  response  to  the  input.  The  more  immediate  the  feedback,  the  less  confusion  as  to 
source  of  the  error.  The  modality  of  the  feedback  should  be  compatible  with  the  demands 
of  the  task. 

6.  If  errors  occur,  a  correction  capability  should  be  provided  that  minimizes  demands  on  the 
user  and  maximizes  system  throughput. 

7.  Acoustic  displays  must  adequately  reproduce  the  audible  spectrum  in  frequency 
resolution  and  dynamic  range. 

8.  Information  must  be  presented  accurately  in  three  spatial  dimensions. 

9.  Displays  must  be  capable  of  representing  multiple  sources  of  auditory  information  that 
can  be  either  static  or  moving. 

10.  Auditory  information  presentation  must  be  real-time  and  interactive;  that  is,  responsive 
to  the  ongoing  needs  of  the  listener. 
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1 1 .  The  technology  must  be  head-coupled  to  provide  a  stable  acoustic  environment  with 
dynamic  cues  appropriately  correlated  with  head  motion. 

12.  The  technology  must  be  flexible  in  the  type  of  acoustic  information  that  can  be 
displayed;  for  example,  real  environmental  sounds,  acoustic  icons,  speech,  or  streams  of 
multidimensional  auditory  patterns  or  objects.  Durlach  and  Pang  (1986)  have  also 
proposed  that  auditory  displays  be  used  to  enhance  (artificially  magnify)  the  perceptual 
capabilities  to  localize  and  identify  normal  sounds  (i.e.,  super  localization). 

Ultimately,  speech-based  control  and  3D  acoustic  displays  should  be  designed  according  to 
accepted  human  factors  principles,  i.e.,  to  meet  the  need  for  ease  of  use,  transparency  of  control,  and 
adaptability  to  changing  operational  scenarios  and  user  input  styles.  In  addition,  it  would  be  wise  to 
retain  some  redundancy  ("Supplemental"  paradigm)  in  any  system  to  allow  operation  by  either 
manual  or  ASR  control — depending  upon  mission  phase  or  task  demands. 

3.2.1. 4  Future  Research  and  Development 

Continued  research  is  required  to  improve  ASR  robustness  to  multiple  speakers,  new 
dialects,  and  microphone  characteristics.  Integration  of  automatic  lip  reading  and  speech-based 
control  has  been  attempted  as  a  means  to  improve  speech  recognition  in  noisy  environments,  but 
performance  is  still  lacking  (McMillan  et  ah,  1997).  This  would  not  be  appropriate  for  the  warfighter 
wearing  individual  protective  equipment  over  the  face  (e.g.,  respirators).  Further,  speech  recognition 
performance  for  very  large  vocabularies  does  not  yet  appear  adequate  for  application  in  military 
operational  environments. 

Another  issue  that  must  be  addressed  is  the  ability  to  operate  speech-based  controls  in 
multitask,  high  workload  environments  that  include  the  effects  of  task  loading  and  other  physical 
stressors  on  speech  and  their  resultant  impact  on  speech  recognition  performance  (Rajasekaran  & 
Doddington,  1986;  Stanton,  1988).  While  much  research  has  been  conducted  in  this  area  over  the 
last  decade  (e.g.,  ITT's  Command  Voice!  Family  of  Tactical  Voice  Recognition  Systems  appears  to 
provide  state-of-the-art  speech  processing  technology  in  real-time.  High  performance  voice 
recognition  and  control  capability  for  tactical  application  in  high  noise  and  high  stress 
environments.),  it  appears  continued  research  is  needed  to  further  assess  and  reduce  the  impact  of 
these  factors  within  the  military  operational  environment. 

The  reason  for  errors  such  as  front-back  confusions  (responses  which  indicate  that  a  sound 
source  in  the  front  hemisphere,  usually  near  the  median  plane,  is  perceived  to  be  in  the  rear 
hemisphere)  within  the  3D  acoustic  environment  is  not  completely  understood  either.  Research 
indicates  these  errors  are  probably  due  in  part  to  the  static  nature  of  the  laboratory  presented  stimulus 
and  the  ambiguity  resulting  from  the  so-called  cone  of  confusion  (Mills,  1972;  Wenzel,  1991). 
However,  Warren,  Welch,  and  McCarthy  (1981)  note  that  it  may  be  visual  dominance  playing  a  role 
in  auditory  localization.  That  is,  given  an  acoustic  stimulus  in  the  absence  of  any  obvious  visual 
phenomena,  the  perceptual  system  may  be  invoking  a  heuristic  that  assumes  the  source  is  behind  the 
listener  where  it  can’t  be  seen. 

Finally,  refinements  in  the  area  of  "real  time"  control  systems  (Wenzel,  Whightman,  & 

Foster,  1988),  training  techniques  and  multisensory  display  approaches  (Wenzel,  1991)  should  be 
considered  for  further  investigation. 

3.2.2  Eye-  and  Head-Based  Technologies 

The  emergence  of  flight  worthy  HMDs  and  the  development  of  accurate  flight  worthy  Head 
Pointing  Tracker  Systems  (HPS)  has  facilitated  the  development  of  new  target  sensing,  alerting, 
cuing,  designation,  engagement  and  enhanced  weapon  delivery  methods  to  be  implemented  in  the 
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modem  Army  crew  station.  Eye  tracking  technology,  however,  is  relatively  mature  only  in  the 
research  and  development  domain.  No  currently  available  eye  tracking  systems  appear  to  be 
dependable  enough  or  automatic  enough  for  operational  applications,  nor  are  there  any  current 
systems  identified  as  being  available  in  a  completely  militarized  configuration. 

Magnetic,  ultrasonic,  and  electro-optical  technologies  are  now  employed  instead  of  the  direct 
mechanical  connections  found  with  the  first  head  tracking  system  designs.^  Some  of  the  performance 
parameters,  as  well  as  the  strengths  and  weaknesses  of  each  approach,  are  summarized  in  Table  1. 

Table  1.  Performance  parameters,  strengths  and  weaknesses  of  eye-/head-based  technologies 
(adapted  from  McMillan  et  al.  1997,  p.  740) 


ticker-- 
:  Technology 
Category 

Range  of  '  Accuracy 
Angular  Range 

Inputs  (RMS  (milliradlans) 
(RMS) 

r^-'.-Silngths 

"'^’Waalaieiier"  ' 

Sources 

Electro-optical 
using  rotating  IR 
beams  or  planes  of 
light 

AZ:  ±180° 

EL:  ±70° 

Roll:  ±35° 

3  to  10 

AvaiiaDiiiiy 

Meimei  weigni  t  iz 
oz) 

Reliability  of  moving 
parts 

No  head  position 
information 

chop 

Sun  modulation 

Production  {F4 
Phantom,  AH-64 
Apache,  and  A-129 
Mangusta) 

Electro-optical 
using  LED  arrays 

AZ:±180° 

EL:  ~+60° 

Roll:  -±45° 

ItolO 

Simple  installation 
Minimum  added 
helmet  weight 

High  accuracy 

Coverage 

Limited  motion  box 
Covertness 

Reflections 

IR  energy 
sources 

Prototype 

Electro-optical 
using  videometric 
techniques 

AZ:  ±180° 

EL:  ~±60° 

Roll:  ~±45° 

2  to  15 

No  added  helmet 
weight 

Limited  motion  box 
Helmet  surface 
integrity 

Reflections 

IR  energy 
sources 

Prototype 

Ultrasonic  concepts 

AZ:  ±180° 

EL:  -±90° 

Roll:  -±45° 

5  to  10 

Minimum  added 
helmet  weight 

Partial  blockage 

Stray  cockpit  signal 
returns 

Accuracy 

No  head  position 
information 

Air  flow  and  Prototype 

turbulence 

Ultrasonic  noise 

sources 

Multi-path 

signals 

Magnetic  concepts 
AC  or  DC 

AZ:  ±180° 

EL:  -±90° 

Roll:  -±180° 

1to8 

Very  low  added  helmet 
weight 

Simple  mechanization 
Good  noise  immunity 
High  accuracy 

Very  large  motion  box 

Ferromagnetic  an/or 
metal  conductive 
surfaces  cause  field 
distortion  (cockpit 
metal,  moving  seat, 
helmet  CRTs) 

Changing 
locations  for 
metal  objects 
Rarely— 
magnetic  fields 

AC  system  in  low- 
rate  production  for 
AH-66  Comanche 
Several 
commercial 
variations  of  AC 
and  DC  designs  in 
production 

As  shown  above,  only  the  electro-optical  system  using  rotating  infrared  beams  and  the 
magnetic  tracking  systems  are  currently  in  production.  Although  mature  as  laboratory  research 
instrumentation,  the  current  generation  of  devices  has  probably  not  yet  reached  the  level  of  trae 
practicality  for  the  Army  crew  station  environment. 

One  technical  challenge  to  overcome  is  to  track  the  head  and  eyes  with  the  speed  and 
accuracy  required  for  natural  human-machine  interaction.  The  head  can  be  positioned  with  high 
accuracy  and  is  more  amenable  to  precise  conscious  control  than  the  eye.  Using  head-based  control 
alone,  however,  can  lead  to  frequent  and  tiring  motions  that  are  unnatural  to  the  user.  Acceptance 


^  Detailed  descriptions  of  each  approach  are  provided  by  Ferrin  (1991).  Kocian  and  Task  (1995)  examine  the 
factors  to  be  considered  in  selecting  a  particular  measurement  approach. 
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problems  seem  likely  if  the  user  is  required  to  make  frequent  head  movements  when  eye  movements 
would  normally  be  employed. 

Eye  tracking  has  great  potential  within  the  conventional  crew  station.  For  example,  this 
technology  may  be  used  for  explicit  control  such  as  designating  targets  in  the  external  world  (e.g.,  for 
off-boresight  weapons)  and  selecting  items  on  crew  station  displays.  It  may  also  be  used  for  implicit 
control  functions  such  as  providing  context  information  for  voice  or  gesture  controls,  or  allowing 
enhanced  resolution  of  just  the  local  area  (area  of  interest)  being  viewed  within  a  display.  By  the  use 
of  eye  tracking  it  will  be  possible  to  reposition  the  cursor  by  the  combination  of  fixing  the  eye  on  the 
required  point  and  commanding  the  reposition  with  either  a  manual  control  or  by  the  use  of  a  voice 
command.  This  method  of  interaction  has  the  potential  to  provide  significant  reductions  in  warfighter 
workload. 

In  comparison  with  head  pointing  alone,  eye-based  control  offers  potential  advantages  of 
speed,  ability  to  cover  a  wider  angular  envelope,  and  the  possibility  of  less  performance  deterioration 
under  turbulence-induced  vibration  or  during  high-g  combat  maneuvering. 

3.2.2.1  Design  Methods  and  Principles 

There  are  a  good  deal  of  data  to  assist  in  the  design  of  eye-  and  head-based  command 
systems.  One  set  of  tools  often  used  to  compare  various  control  techniques  are  movement  time 
models  such  as  Fitts'  Law  (Fitts  &  Peterson,  1964).  These  models  attempt  to  capture  the  speed- 
accuracy  trade-off  that  is  a  necessary  component  of  precision  control  activity. 

In  addition  to  the  movement  time  prediction  models,  McMillan  et  al.  (1997)  present  the 
following  guidelines  for  ARL/HRED  to  consider  when  designing  or  evaluating  a  head-or  eye-based 
control  system: 

1 .  The  optimal  gain  for  head-based  control  of  a  cursor  on  a  video  monitor  will  be  in  the  range 
of  0.3-0.6  (Lin,  Radwin,  &  Vanderheiden,  1992). 

2.  Head-based  control  which  requires  frequent,  precise  head  movements  to  replace  eye 
movements  will  be  fatiguing  and  poorly  accepted  by  users. 

3.  The  use  of  long  line-of-sight  (LOS)  dwell  times,  e.g.,  greater  than  approximately  300 
milliseconds,  eliminates  the  speed  advantage  of  using  eye-based  control  (Calhoun  &  Janson, 
1991a). 

4.  The  use  of  voice  commands  as  a  consent  response  in  multisensory  systems  may  be  slower 
than  manual  button  presses  because  of  delays  in  the  ASR  system  (Calhoun  &  Janson,  1991b). 

5.  Human  performance  with  an  eye-based  control  system  will  generally  be  better  and  more 
natural  without  direct  LOS  feedback  (Borah,  1995;  Calhoun  &  Janson,  1991a;  Jacob,  1995). 
With  a  head-hased  system,  LOS  feedback  is  almost  always  required. 

6.  Processing  delays  and  lags  can  be  significant  problems  in  head-  and  eye-based  systems  and 
need  to  be  carefully  managed  during  the  interface  design  process.  As  a  rule  of  thumb,  the 
delay  from  head/eye  movement-to-display-to-system  response  should  be  kept  under  100 
milliseconds,  (p.  746) 

3.2.2.2  Future  Research  and  Development 

The  primary  area  in  which  eye-tracking  hardware  and  software  needs  improvement  is  in  the 
stability  and  repeatability  of  the  measurements.  Brief  dropouts  and  jitter  that  may  be  acceptable  in 
research  environments  will  quickly  erode  user  confidence  in  applied  settings.  Speed  improvements 
are  also  needed  both  in  the  basic  position  measurement  process  and  in  the  algorithms  that  transform 
these  measurements  for  human-system  interaction. 


9 


Seamless  interpretation  of  head  and  eye  movements  to  infer  user  interest,  needs,  and  desires 
("Intelligent  Interface"  paradigm)  appears  to  be  a  much  more  powerful  research  and  design  path  for 
this  technology  area.  Development  of  multisensory  interfaces  to  include  head  and  eye  inputs  should 
serve  to  expand  the  bandwidth  (throughput)  of  human-system  communication.  This  approach  may 
actually  help  to  constrain  overall  system  cost.  For  example,  by  using  eye  and  gesture  as  redundant 
pointing  mechanisms,  lower  precision  may  be  acceptable  in  each  measurement  subsystem.  Similarly, 
if  speech  recognition  is  used  to  issue  specific  commands  while  the  referents  are  specified  with  eye 
and  gesture,  smaller  vocabularies  will  be  required — expanding  the  life-span  of  currently  fielded  ASR 
systems. 

3.2.3  Gesture/Tactile  Technologies 

Two  principal  measurement  systems  are  used  in  gesture  recognition:  (1)  systems  that 
measure  the  position  of  limbs  and  body  segments  in  3D  space,  and  (2)  systems  that  measure  the  joint 
angle  directly  (Sturman  &  Zeltzer,  1994). 

Glove-based  techniques  are  the  current  method  of  choice  for  hand  and  finger  joint  angle 
measurement.  Three  glove  systems  are  widely  available  at  present,  the  DataGlove™,  the  Dexterous 
HandMaster™  (DHM),  and  the  CyberGlove™.  The  DataGlove™  is  no  longer  produced,  but  is  still 
available  in  many  laboratories.  The  characteristics  of  these  three  devices  are  summarized  in  Table  2. 
As  shown  here,  the  DHM™  and  CyberGlove™  appear  to  have  the  accuracy  required  for  complex 
posture  and  gesture  recognition. 

Table  2.  Glove-based  technology  characteristics  (adapted  from  McMillan  et  al.,  1997;  p.  751) 


DataGlove™ 


Construcstion 


Cloth  glove  with  fiber 
optic  bundles  attached  to 
the  back 


Joint  bending  sensed  by  attenuation  of  transmitted  light. 
10  flex  sensors  measure  lower  two  joints  of  each  finger 
and  two  joints  of  thumb.  Operates  at  60Hz.  Magnetic 
tracker  can  be  attached  to  back  of  glove. 


Rated  at  r,  but  5-10°  is 
typical.  (Quam,  Williams, 
Agnew,  &  Browne,  1989; 
Wiseet.  al.,  1990) _ 


Dexterous 

HandMaster™ 


Exoskeleton-like  device 


Hall  Effect  sensors  used  as  potentiometers,  20  sensors 
measure  each  finger  joint,  finger  abduction  and 
complex  motion  of  thumb.  Operates  at  up  to  75Hz  with 
20  sensors.  Magnetic  tracker  can  be  attached. 


Better  than  1°  (Sturman  & 
Zeltzer,  1994) 


CyberGlove™ 


Cloth  glove  with  foil 
strain  gauges  sewn  into 
the  back 


18  or  22  sensor  models  measure  finger  and  thumb  joint 
angles,  finger  and  thumb  abduction,  palm  arch  and 
wrist  bending.  Operates  at  up  to  149Hz  with  18 
sensors.  Magnetic  tracker  can  be  attached. 


Better  than  1°  (Sturman  & 
Zeltzer,  1994) 


Feedback  requirements  for  applications  that  involve  simulated  object  manipulation,  vehicle 
confrol,  and  robot  operations  are  still  the  subject  of  much  research  and  development.  The  importance 
of  simulated  tactile  and  kinesthetic  feedback  depends  on  the  specific  task,  the  experience  of  the  user, 
the  availability  of  substitute  visual  and  auditory  cues,  and  the  implementation  of  the  artificial 
feedback.  In  many  applications,  however,  the  only  feedback  that  is  provided  is  the  system's  response 
to  a  recognized  gesture. 

Pneumatic,  shape-memory  materials  and  vibrotactile  technologies  have  been  used  for 
providing  tactile  feedback.  Experiments  have  also  been  performed  using  hydraulic  systems,  electric 
stimulation  of  the  skin  or  even  direct  neuromuscular  stimulation.  The  currently  available  devices  are 
few  and  this  area  is  still  mostly  a  research  domain  with  one  notable  exception  being  the  Tactile 
Situational  Awareness  System  (TSAS)  under  development  by  the  Naval  Aerospace  Medical 
Research  Laboratory  (NAMRL).  This  system  is  discussed  in  more  detail  in  Section  3.2.5.2. 
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Force  feedback  systems  can  use  electric,  hydraulic  or  pneumatic  technologies.  They  were 
first  applied  to  telemanipulation  arms.  Increasing  miniaturization  has  allowed  the  incorporation  of 
such  systems  into  gloves  and  joysticks.  Despite  this  progress,  the  main  disadvantage  is  that  most  of 
these  systems  remain  bulky  and  intrusive,  which  prevents  their  use  in  transportable  devices  or  the 
already  space  constrained  environment  of  ground-based  and  airborne  crew  stations. 

3.2.3. 1  Design  Methods  and  Principles 

While  this  area  of  research  is  still  relative  immature,  McMillan  et  al.  (1997)  have  suggested 
some  general  design  guidelines  that  ARL/HRED  may  find  applicable: 

1 .  Gesture-based  control  should  offer  learning  and  performance  advantages  if  the  task  is  based 
on  a  set  of  already  learned  signs  or  signals.  Glove-based  translation  of  American  Sign 
Language  is  an  example. 

2.  Gesture-based  control  should  offer  learning  and  performance  advantages  if  the  natural 
coordination  of  the  body  can  be  employed  to  coordinate  multiple  degrees  of  freedom  in  the 
external  device.  Finger  walking  to  control  the  locomotion  of  a  legged-robot  is  an  example 
(Sturman  and  Zeltzer,  1993). 

3 .  Gesture-based  control  may  be  less  effective  than  conventional  control  if  the  task  requires 
high-resolution  control  of  a  single  degree  of  freedom.  At  least  two  factors  contribute  to  this: 
(a)  conventional  controls  often  have  higher  resolution  than  gesture-based  devices,  and  (b) 
conventional  controls  often  provide  support  and  damping  that  is  helpful  in  precision  control 
situations.  This  may  not  be  true  for  applications  in  which  gesture  affords  more  natural,  user- 
scaled  control  location. 

4.  Gesture-based  control  may  be  less  effective  than  conventional  control  if  tactile  and 
kinesthetic  feedback  are  important  for  task  performance. 

5.  Gestures  should  be  concise  and  quick  in  order  to  minimize  fatigue.  High  precision  over  a 
long  period  of  time  should  be  avoided. 

6.  Since  most  systems  capture  every  motion  of  the  user's  hand,  the  controller  must  provide  well- 
defined  means  to  detect  the  intention  of  gestures.  An  example  is  Baudel  and  Beaudouin- 
Lafon's  (1993)  system  for  controlling  computer-based  presentations  to  an  audience.  Gestures 
are  acted  on  only  when  the  user  is  gesturing  within  the  "active  zone"  of  the  projection  screen. 
Gestures  to  the  audience  are  not  recognized,  (p.  754) 

3.2.3.2  Future  Research  and  Development 

The  dynamic  and  often  repetitive  body  movements  involved  in  gestural  corrammication  can 
be  a  source  of  fatigue;  thus  it  is  important  to  use  concise  and  simple-to-execute  gestures.  Further, 
high  precision  cannot  be  relied  on  over  time,  therefore  systems  must  incorporate  adequate  or 
appropriate  feedback  to  ensure  that  the  desired  gesture  was  produced. 

Gesture  input  is  made  more  difficult  in  a  dynamic  environment.  As  with  head-based  control, 
hand  movements  are  impaired  by  G  forces  and  by  shock  and  vibration.  Gesture-based  input  may  also 
be  impaired  by  the  restrictions  imposed  with  wearing  individual  protective  equipment  (IPE)  such  as 
chemical  or  arctic  gloves.  In  addition,  gesture  input  is  characterized  by  large  intra-  and  inter-subject 
variability.  The  difficulty  of  precisely  reproducing  a  gesture  is  a  potential  source  of  precision  and 
recognition  problems.  Differences  between  individuals  suggest  that  some  training  of  the  recognition 
system  is  generally  needed. 
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3.2.4  Biopotential  Technologies 

The  notion  of  operating  a  device  simply  by  thinking  about  the  desired  action  represents  the 
ultimate  in  intuitive  control.  The  principal  objective  is  to  measure  biopotential  activity  from  the 
operator  so  that  it  can  designate  control  actions  or  augment  other  control  modalities  (NATO,  1998). 

3.2.4.1  Electromyographic  (EMG)-Based 

EMG-based  control  uses  the  electrical  signals  that  accompany  muscle  contractions.  The 
EMG  signal  results  from  the  asynchronous  firing  of  hundreds  of  groups  of  muscle  fibers;  controlling 
the  force  produced  by  the  muscle  contraction  (Parker  &  Scott,  1986;  Scott  &  Parker,  1988). 

To  date,  the  only  sustained  development  within  the  EMG-based  technology  arena  has  been 
for  prosthetic  device  operation.  Most  common  prosthetic  control  algorithms  employ  simple  on-off 
control  based  on  the  level  or  rate  of  change  of  EMG  activity.  For  example,  if  muscle  activity  at  one 
recording  site  exceeds  some  threshold,  a  prosthetic  device  moves.  Above-threshold  activity  at 
another  site  causes  the  prosthetic  device  to  move  in  the  opposite  direction.  Movement  stops  when  the 
EMG  at  both  sites  is  below  threshold. 

Most  current  systems  rely  on  visual  feedback,  or  auditory  and  vibration  cues  from  prosthetic 
motors,  to  provide  this  information  (McMillan  et  al.,  1997).  Attempts  to  provide  grip  force  feedback 
in  prosthetic  devices  have  most  often  employed  vibratory  or  electrical  cues  proportional  to  grip  force. 

3.2.4.2  Electroencephalographic  (EEG)-Based 

EEG  recorded  from  the  surface  of  the  scalp  represents  a  summation  of  the  electrical  activity 
of  the  brain.  EEG-based  control  is  presently  confined  to  laboratory  systems  and  is  based  on  one  of 
two  general  approaches  (McMillan  et  al.,  1997): 

1 .  The  application  of  operant  conditioning  and  biofeedback  methods  to  enable  the  user  to 
develop  voluntary  control  of  the  magnitude  of  specific  EEG  responses  or  rhythms. 

2.  The  application  of  pattern  recognition  algorithms  to  detect  the  EEG  characteristics  associated 
with  specific  body  movements,  eye  fixations,  or  utterances  and  thereby  predict  a  desired 
control  action.  No  current  algorithms  attempt,  or  are  capable  of,  thought  or  intent 
recognition.  This  approach  requires  no  user  training,  but  does  require  that  the  pattern 
recognition  algorithms  be  trained  with  repetitions  of  the  movements,  fixations,  or  utterances. 
This  process  is  directly  analogous  to  the  training  of  a  speaker-dependent  speech  recognition 
system,  (p.  758) 

User  feedback  with  EEG-based  control  systems  has  been  implemented  as  both  an  inherent 
part  of  the  task,  e.g.,  movement  of  the  display  element  being  controlled  by  EEG,  and  as  a  separate 
display  element  when  movement  of  the  controlled  element  does  not  provide  timely  feedback. 

Although  current  EEG-based  control  systems  represent  beginning  steps  toward  a  "thought- 
based"  design  approach,  significant  long-term  development  will  likely  be  required  to  reach  this  goal. 

3.2.4.3  Current  Applications  and  Evaluations 

Although  current  technology  limits  our  ability  to  achieve  such  natural  control  systems,  many 
practical  biopotential  devices  have  been  designed  and  other  promising  technologies  are  being 
evaluated  in  the  research  community.  For  example,  EMG-controlled  prosthetic  hands  and  wrists  are 
of  significant  value  for  people  with  lower-arm  amputations.  This  area  represents  the  most  significant 
real-world  application  of  biopotential-based  technology. 
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Biopotential-based  control  has  been  primarily  employed  as  a  substitute  for  conventional 
control  methods.  A  NASA  study  (Clark  &  Phillips,  1988)  investigated  the  possibility  of  using  EMG 
control  for  robotic  applications  and  found  that  direct  use  of  the  EMG  signal  was  adequate  for  simple, 
single  degree-of-freedom  movements.  More  recent  work  (Junker,  Berg,  Schneider  &  McMillan, 
1995)  has  shown  that  subjects  can  use  both  EMG  and  EEG  signals  extracted  from  electrodes  on  the 
forehead  to  track  computer-generated  targets  with  a  cursor.  Nelson  et  al.  (1998)  also  found  that,  for 
discrete  on/off  responses,  the  EMG-EEG  control  scheme  can  achieve  high  accuracy  with  little  user 
training  and  with  reaction  times  comparable  to  manual  switches. 

In  summary,  one-and  two-dimensional  control  and  simple  item  selection  have  been 
demonstrated  with  current  laboratory  systems.  The  size,  weight,  and  cost  of  these  systems  are  not 
serious  constraints,  and  learning  EEG-based  control  does  not  appear  to  require  any  special  skills  or 
individual  characteristics.  However,  until  the  flexibility,  precision,  and  reliability  of  biopotential- 
based  technologies  can  be  increased  to  accommodate  the  demands  of  the  military  operational 
environment,  current  applications  are  probably  limited  to  assistive  devices  for  the  physically 
challenged  and  input  devices  for  entertainment  systems. 

3.2.4.4  Future  Research  and  Development 

Current  biopotential-based  systems  could  supplement  a  keyboard  and  mouse  for  basic 
computer  input  operations.  In  the  military  crew  station,  such  discrete  actions  as  radio  frequency 
selection  or  multifunction  display  operation  could  be  the  probable  next  step.  However,  much  remains 
to  be  investigated  regarding  the  precision  and  reliability  of  biopotential-based  control  during  high 
workload  and  multitask/multisensory  environments. 

3.2.5  Other  Technologies  of  Interest 

3.2.5. 1  Virtual  Retinal  Display  (VRD)^ 

The  VRD  is  a  personal  display  device  that  scans  light  directly  onto  the  viewer's  retina.  In  a 
conventional  display  a  real  image  is  produced.  The  real  image  is  either  viewed  directly  or,  as  in  the 
case  with  most  HMDs,  projected  through  an  optical  system  and  the  resulting  virtual  image  is  viewed. 
The  projection  moves  the  virtual  image  to  a  distance  that  allows  the  eye  to  focus  comfortably. 
Because  the  VRD  scans  light  directly  on  the  retina,  the  viewer  perceives  a  high-resolution,  wide  field 
of  view  image  (the  system  has  a  sufficient  bandwidth  to  handle  displays  with  well  over  a  million 
pixels). 

The  field  of  view  of  the  VRD  is  controlled  by  the  scan  angle  of  the  primary  scaimer  and  the 
power  of  the  optical  system.  Initial  systems  with  greater  than  60  degree  horizontal  fields  of  view 
have  been  demonstrated.  Systems  with  100  degree  fields  of  view  are  feasible.  See  through  systems 
will  have  somewhat  smaller  fields  of  view.  Current  see  through  systems  with  over  40  degree 
horizontal  fields  of  view  have  been  demonstrated. 

Brightness  may  be  the  biggest  advantage  of  the  VRD  concept.  The  current  generation  of 
personal  displays  do  not  perform  well  in  the  high  illumination  environments  that  can  exist  in  airborne 
crew  stations.  Again,  because  the  image  is  presented  directly  onto  the  retina  there  is  no  opportunity 
for  the  image  to  "wash  out"  in  bright  simlight  conditions. 

Using  seed  funds  from  the  Washington  Technology  Center  the  first  VRD  prototype  was 
developed  in  the  Human  Interface  Technology  Laboratory  (HTTL)  by  Dr.  Tom  Furness,  Joel  Kollin, 


^  Retrieved  May  10, 2001  from  Tidwell,  M.,  Johnston,  R.  S.,  Melville,  D.,  &  Furness,  T.  A.  The  Virtual  Retinal 
Display  -  A  Retinal  Scanning  Imaging  System.  Seattle,  WA;  Human  Interface  Technology  Laboratory, 
University  of  Washington  fhttp://www.hitl.washington.edu/Dublications/p-95-l/  -  5) 
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and  Bob  Burstein.  As  a  result  of  the  work,  a  patent  application  was  filed  and  the  technology  licensed 
to  a  Seattle  based  start  up  company.  Microvision,  Inc.  Under  terms  of  the  agreement.  Microvision 
funded  a  four-year  effort  in  the  HITL  to  develop  the  technologies  that  will  ultimately  lead  to  a 
commercially  viable  VRD  product.  This  development  work  began  in  November  1993. 

In  1999,  Microvision  delivered  a  prototype  helmet  mounted  VRD  to  the  U.S.  Army 
Aeromedical  Research  Laboratory  (USAARL),  Fort  Rucker,  AL,  to  determine  its  capability  to  meet 
the  RAH-66  Comanche  HMD  performance  specifications  (Rash,  Harding,  Martin,  &  Beasley,  1999). 
While  falling  slightly  short  of  the  performance  expectations  required  by  Comanche,  the  overall 
evaluation  results  indicated  that  VRD  technology  offers  many  advantages  over  more  mature 
technologies  in  the  area  of  luminance  output,  field  of  view,  abberations  and  weight.  Deficiencies 
were  noted  in  the  areas  of  luminance  and  contrast  uniformity  and  contrast  transfer  function  (CTF).  In 
addition,  a  slow  vertical  drift  was  detected  in  the  imagery.  This  drift  could  cause  significant 
disruption  to  tracking  and/or  targeting  performance  if  not  corrected. 

In  summary,  VRDs  appear  to  offer  much  promise  as  alternative  display  technologies.  With 
continued  research  the  prospects  of  having  systems  ready  for  the  operational  environment  appear 
very  good  for  the  near-  to  mid-term. 

3.2.5.2  Tactile  Vests 

Lack  of  spatial  orientation  is  blamed  for  the  loss  of  about  30  lives  and  hundreds  of  millions 
of  dollars  worth  of  aircraft  every  year  among  U.S.  forces  alone.  In  conditions  of  poor  visibility,  the 
chance  of  becoming  spatially  disoriented  increases  exponentially.  Unfortunately  this  bad  visibility  is 
apt  to  be  encountered  when  precise  aircraft  movements  are  most  needed,  such  as  on  search  and 
rescue  missions  or  combat  sorties.  Using  night  vision  goggles  and  then  being  blinded  by  flares  or 
gunfire  is  particularly  distracting. 

The  Naval  Aerospace  Medical  Research  Laboratory  (NAMRL)  in  Florida  has  focused  on 
helping  helicopter  pilots  to  keep  their  aircraft  on  course.  What  the  NAMRL  scientists  have  come  up 
with  is  the  TSAS.  The  device  employs  an  array  of  18  pneumatic  vibrators  built  into  a  vest  and  meant 
to  be  worn  under  a  flight  suit.  Linked  to  a  satellite  navigation  system  and  other  instruments,  the  vest 
provides  altitude,  rate  of  movement  and  directional  data  through  changes  in  the  intensity  and 
frequency,  as  well  as  the  direction,  of  the  vibrations. 

All  18  of  the  vibrating  buzzers  can  be  triggered  in  different  sequences.  For  example,  a  ripple 
of  movement  up  a  pilot's  chest  could  mean  that  his  aircraft's  nose  was  lifting  higher.  A  series  of 
pulses  increasing  in  tempo  along  his  right  ribs  could  mean  that  the  chopper  was  drifting  further  and 
further  to  the  right.  Pilots  who  have  tested  the  TSAS  vest  report  that  it  makes  stationary  hovering 
much  easier;  even  when  they  ignored  the  ground  and  their  conventional  instruments.'' 

This  technology  was  recently  purchased  for  use  in  the  V-22  Osprey  Program.  Similar 
vibrating  clothing  and  seats  are  being  investigated  for  a  wide  range  of  military  applications  where 
spatial  awareness  is  imperative.  For  fighter  pilots,  tactile  stimuli  could  help  them  keep  track  of 
wingmen  or  draw  attention  to  adversaries  approaching  from  unexpected  angles.  Aquatic  commandos 
like  the  U.S.  Navy  SEALS  are  also  looking  at  the  system  to  help  them  navigate  better  imderwater.  By 
extension,  submarine  commanders  could  use  tactile  stimulation  to  let  them  know  if  they  are  drifting 
off  course  or  towards  obstacles,  or  to  keep  them  informed  of  other  vessels  or  torpedo  threats.^ 


*  Retrieved  May  10,  2001  from  Tactile  vest  gives  pilots  seat-of-pants  feeling.  By  Bill  Kaczor  --  The  Associated 
Press,  Tuesday,  May  18, 1999  fhttt)://www.canoe.ca/CNEWSScience9905/l  8  pilots.html) 

^  Retrieved  May  10,  2001  from  HOW  TOUCHING,  Beyond  2000.com  30th  Aug,  2000 
('http://www.bevond2000.com/pda/storv  729  pda.htmlf 
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3.2.53  Volumetric  Displays 

The  problem  of  displaying  3D  information  in  a  useful,  interactive  format  that  enables  faster 
and  more  reliable  interpretation  of  data  that  are  inherently  3D  in  nature  has  been  faced  for  many 
years.  In  some  applications  3D  information  data  is  mapped  onto  two-dimensional  (2D)  displays 
forcing  the  user  to  reconstruct  a  mental  3D  view  of  the  situation.  Examples  of  this  include  air  traffic 
control,  undersea  navigation,  and  medical  imaging.  Stereoscopic,  autostereoscopic,  and  holographic- 
based  3D  technologies  have  all  addressed  these  applications  with  varying  degrees  of  success 
(McAllister,  1993).  One  drawback  to  these  methods  is  the  limited  viewing  angle  presented  to  the 
viewer.  Related  to  this  problem  is  the  limited  number  of  observers  able  to  view  the  display  at  one 
time  and,  in  some  cases,  the  necessity  of  using  special  eye  wear.  These  displays  provide 
psychological  depth  cues  but  lack  important  physiological  cues,  especially  motion  parallax  (Phillips, 
1984;  Williams,  Wefer,  &  Clifton,  1992). 

A  volumetric  3D  display  presents  an  image  in  a  true  3D  volume  that  observers  can  view  from 
any  angle  and  can  provide  both  psychological  and  physiological  depth  cues.  The  image  points,  or 
voxels,  are  physically  formed  in  all  three  spatial  dimensions  that  gives  the  viewer  true  depth  cues 
(binocular  parallax,  accommodation,  convergence)  without  the  need  for  any  special  viewing  aids.^ 
Unfortunately,  this  technology  is  not  yet  developed  enough  to  be  valuable  for  the  individual  crew 
station  environment  that  is  the  focus  of  this  ARL/HRED  effort.  The  space  requirements  for 
implementing  this  technology,  not  to  mention  the  lack  of  data  available  to  indicate  its  viability  under 
shock  and  vibration,  make  it  unlikely  that  this  will  be  viable  for  the  Army  crew  station  environment 
in  the  near  term. 

3.3  EXPECTED  BENEFITS’ 

Technology  has  advanced  to  such  an  extent  that  there  are  now  a  number  of  alternative  ways 
of  entering  or  inputting  data  and  information  into  an  military  crew  stations.  However,  like  most 
technology  insertion  activities,  if  not  integrated  properly  then  significant  problems  can  occur  in 
service  use.  To  ease  the  operator  burden,  the  implementation  of  these  alternative  technologies 
requires  a  human  centered  approach  to  integration.  In  design,  operator  requirements  should  retain  a 
major  influence. 

As  operator-in-the-loop  systems  become  more  complex,  and  the  pace  of  conflict  increases, 
one  expected  benefit  of  implementing  alternative  technologies  may  be  they  help  in  these  potential 
"overload"  conditions  by  offering  redundant  or  supplemental  control/display  alternatives.  Another 
expected  benefit  is  the  potential  for  a  reduction  in  training  requirements,  time  and  subsequently 
costs.  Each  of  these  is  briefly  discussed  in  the  sections  below;  however,  identifying  potential  areas  of 
benefits  offered  by  technologies  in  the  earliest  phases  of  research  (i.e.,  without  quantitative 
laboratory  or  field  research  performance  data)  becomes  very  speculative. 


®  Retrieved  May  10,  2001  from  Soltan,  P.,  Lasher,  M.,  Dahlke,  W.,  Acantilado,  N.,  McDonald,  M.  (1996). 

Lasar  projected  3-D  volumetric  displays.  San  Diego,  CA:  NCCOSC  RDT&E  Division,  Technical  Information 
Division.  ihttp://www.nosc.mil/sti/r)ublications/reprints/3dvolumetricdisplav/reprints/soltan/volu.html) 

’  Much  of  the  content  of  this  section  is  extracted  from  a  paper  by  Leger,  A.  (1998).  Synthesis-  and  expected 
benefits  analysis.  In  Alternative  control  technologies:  Human  factors  issues  (RTO-EN-3).  Neuilly-Sur-Seine 
Cedex,  France;  North  Atlantic  Treaty  Organization,  Research  and  Technology  Organization.  This  paper  presents 
a  lengthy  synthesis  and  analysis  of  advanced  technology  capabilities,  limitations,  and  benefits  for  military 
applications. 
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3.3.1  Redundancy  and  Alternattve  Solutions 

Alternative  technologies  may  be  used,  in  many  cases,  as  supplements  and  substitutes  within 
an  existing  interface.  Supplements  are  used  when,  for  example,  a  new  task  is  being  introduced,  or  it 
may  be  a  substitute  for  another  control. 

The  most  simple  approach,  redundancy  to  already  existing  manual  control,  would  create  a 
total  or  partial  equivalence  between  the  new  control  and  the  traditional  manual  control  modality. 

The  advantage  would  be  to  offer  to  the  warfighter  an  alternative  control  option,  especially  when 
short-term  memory  problems  are  encoimtered  with  HOTAS  switches. 

This  kind  of  consideration  shows  that  it  is  of  interest  to  assess  benefits  and  weakness  of  the 
potential  technological  candidates  in  regard  of  human  factors  and  system  engineering  technology. 
Tables  3  and  4  show  an  example,  far  to  be  exhaustive,  of  such  assessment  for  the  reviewed 
technologies,  relative  to  current  state  of  the  art  characteristics. 

Table  3  considers  five  system  engineering  criteria:  (1)  response  rapidity,  as  the  time  between 
an  input  to  the  control  system  and  an  output  to  the  system  (fast  =  20  ms  or  less),  (2)  reliability  (makes 
a  consistent  response  to  an  operator  input),  (3)  ease  to  provide  a  feedback,  (4)  tolerance  to  dynamic 
environments  (e.g.,  shock/vibration;  g-forces),  and  (5)  ease  to  set  up  the  system.  Speech/audio-based 
devices  and  eye-/head-trackers  currently  present  some  obvious  limitations  in  speed  and  system  setup 
respectively.  However,  these  alternative  technologies  do  offer  acceptable  to  good  benefits  across  the 
remaining  categories  and  are  currently  implemented  in  many  military  and  commercial  systems. 
Continued  advancement  in  the  area  of  tactile  feedback  shows  great  promise  as  witnessed  by  the 
TSAS  program;  and  current  commercial/medical  applications  of  biopotential-based  technologies  will 
surely  advance  R&D  for  its  use  within  the  military  environment.  However,  gesture-  and  biopotential- 
based  technologies  have  serious  limitations  and  uncertainties  in  most  areas. 


Table  3.  Compliance  of  alternative  technology  with  various  system  and  environmental  criteria 
(adapted  from  Leger,  1998) 
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Table  4  examines  the  same  technologies  against  some  operator's  usage  criteria:  (1)  low 
attention  on  control,  (2)  high  confidence  in  system  operation,  (3)  intuitive  interaction/control,  (4) 
easy  error  correction/recovery,  and  (5)  delay  between  the  control/display  intent  and  the  input.  Head- 
and  speech/audio-based  technologies  appear  to  comply  quite  well  to  all  these  criteria,  with  a 
limitation  to  the  speed  of  input  associated  with  current  generation  ASR  technologies.  Eye-based 
technologies  exhibit  some  uncertainties  and  weaknesses,  especially  in  the  area  of  user  confidence  in 
the  system  and  the  inability  to  correct  or  recover  easily  from  errors.  Again,  gesture  and  biopotential- 
based  technologies  are  the  least  compliant  and  suffer  from  a  lack  of  maturity  for  the  operational 
environment. 
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Table  4.  Compliance  of  alternative  technology  with  various  operator  use  criteria  (adapted  from 
Leger,  1998) 
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3.3.2  Training  Considerations 

A  strong  point  to  the  introduction  of  alternative  technologies  is  that  they  are  supposed  to  be 
more  intuitive  than  conventional  controls.  This  should  imply  that  training  needs  would  be  reduced, 
yielding  significant  benefits  as  training  is  inevitably  associated  with  costs.  Things,  however,  may  not 
be  that  simple,  as  technology  does  not  perfectly  mediate  the  natural  modalities  used  by  the  operator. 
On  the  other  hand,  in  regard  of  memory  management,  using  alternative  control  could  help  the  pilot  to 
rapidly  reach  a  given  level  of  global  proficiency  on  the  aircraft  system. 

The  relationship  between  characteristics  of  technology  and  training  issues  is  not  very  well 
understood.  Some  technologies,  in  their  current  status,  explicitly  call  for  some  kind  of  training,  as 
EMG  and  EEG.  Gesture  is  also  highly  susceptible  to  require  substantial  training  if  specific 
communication  capabilities  are  used. 

This  domain  not  clearly  defined  and  little  work  has  been  identified  in  the  literature  that 
addresses  the  impact  of  alternative  controls  on  training.  It  could  be  expected  that  redundancy  and 
alternative  solutions  could  globally  facilitate  training  on  complex  systems,  as  the  operator’s  limited 
resources  could  be  better  used.  This  kind  of  issue  definitely  deserves  some  attention,  since 
demonstration  of  training  process  improvements  may  constitute  a  strong  point  for  integration  of  these 
technologies  in  existing  and  future  cockpits. 


3.4  SURVEY  RESULTS 

An  internet  and  literature  database  search  was  conducted  and  key  SMEs/Sources  were 
identified  and  contacted  to  (1)  capture  commercial,  academic,  and  laboratory  research  and 
development  (R&D)  efforts  not  yet  published  in  the  open  literature  and  (2)  support  development  of 
the  Alternative  Control  and  Display  Technology  Matrix  found  in  Appendix  B.  This  section  describes 
the  method  followed  and  the  results  of  those  endeavors. 


3.4.1  Identification  Method 

Analysis  of  government,  commercial  and  web  database  search  results  was  the  primary 
method  by  which  SMEs/Sources  were  identified.  In  addition,  when  articles  and  citations  were 
thought  to  be  of  use,  the  papers  were  acquired  and  attempts  were  made  to  locate  either  the  personal 
or  corporate  authors  to  obtain  further  information.  A  web  search  was  also  conducted  to  identily 
current  technology  vendors,  as  well  as  R&D  projects  by  various  corporations,  laboratories  or 
academic  research  institutes.  Symposium  announcements  and  agendas  were  identified  as  valuable 
sources  of  SME  information.  Finally,  Dr.  Joe  McDaniel  (AFRL/HECI;  HSIAC  COTR)  initiated  an 
email  request  to  members  of  the  Controls  and  Displays/Voice  Interactive  Systems  Human  Factors 
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Engineering  (HFE)  SubTAG  (Technical  Area  Group)  and  requested  input  regarding  ongoing 
alternative  control  and  display  R«feD  efforts. 

3.4.2  Results 

Human  Systems  lAC  was  able  to  identify  approximately  45  SMEs  or  technology  sources  in 
the  specific  control/display  technology  areas  of  interest.  Due  to  time  and  budgetary  constraints, 
attempts  were  made  to  contact  only  24.  Of  these,  HSIAC  had  received  either  phone  or  email 
feedback  from  nine  by  the  time  this  report  was  completed.  The  following  summarizes  the  results  of 
those  contacts: 

1.  Contact  Information:  Dr.  Glenn  Osga,  PhD,  CPE 

Code  D441 

SPAWARSYSCEN  San  Diego 
Phone:  (619)553-3644 
niailto :  osga@sDawar.navv.mil 

Dr.  Osga's  work  deals  in  the  environment  of  land  attack  mission  areas  and  multimodal 
workstation  design.  There  are  currently  two  versions  of  the  multimodel  watchstation  and  CDs 
available  for  distribution.  We  received  two  papers  from  Dr.  Osga,  one  on  touch  selection  with  further 
points  of  contact  and  a  second  on  studies  of  the  multimodal  watchstation  for  Navy  ship  consoles. 

The  touch  selection  work  deals  with  a  proximity  algorithm  that  cuts  tracking  time  in  half  and  was 
tested  on  a  2D  display. 

2.  Contact  Information:  Capt.  Richard  Friedman 

AFRL/HECP 
2255  H  Street 
WPAFB,  OH  45433 
Phone:  (317)  278-0116 
mailto :  rfriedma@.iupui .  edu 

Capt.  Friedman  has  been  working  on  a  bioelectrical  2-axis  alternative  controller  for  patients 
having  high-level  spinal  cord  injuries  whose  limbs  have  limited  function.  He  noted  that  this 
technology  could  be  used  by  warfighters  as  an  alternative  control  method  under  high-workload 
conditions  (i.e.,  when  their  limbs  were  occupied  with  tasks).  Both  types  of  people  require  additional 
(alternate)  means  of  controlling  their  environment  and  commanding  external  instruments.  He  recently 
authored  a  paper  for  The  Journal  of  Spinal  Cord  Medicine  entitled  "Preliminary  Electrophysiological 
Characterization  of  Functionally  Vestigial  Muscles  of  the  Head:  Potential  for  Command  Signaling. " 

3.  Contact  Information:  Gloria  Calhoun 

AFRL/HECV 

2255  H  Street 

WPAFB,  OH  45433 

Phone:  (937)  255-3856 

mailto:gloria.calhoun@,wt)afb.afmil 

Ms.  Calhoun  is  working  on  an  SBIR  project  that  deals  with  an  integrated,  hands-free  control 
suite  for  wearable  computers.  The  advent  of  wearable  computers  marks  a  potential  revolution  in 
human-machine  interaction  and  necessitates  an  expansion  of  control  and  display  capability.  Hands¬ 
free,  head-up  controllers  are  required  to  fully  exploit  the  advantages  of  wearable  computers  when  the 
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operator  is  also  performing  manual  tasks  in  the  work  setting.  This  SBIR  demonstration  shows  a 
promising  hands-free  interface  for  wearable  computers  with  head-mounted  displays:  the  Voice/Head 
Input  Controller  (VHIC).  Voice  (optimized  for  high  noise)  is  used  for  command  and  text  entry  and 
head  movement  (via  a  head-mounted  inertial  cube)  is  used  for  pointing/spatial  inputs.  The  VHIC  is 
designed  to  work  with  any  PC  platform  using  Windows  application  software,  making  it  useful  for 
most  any  task.  Such  a  hands-free  controller  coupled  with  wearable  computers  has  wide  application: 
maintenance,  inventory,  inspection,  training,  field  medicine,  law  enforcement,  infantry,  disabled 
assistance,  surveying,  and  space  operations. 

4.  Contact  Information:  Dr.  John  Reising 

HFRL/HEC 

Human  Effectiveness  Directorate 

WPAFB,  OH  45433 

Phone:  (937)  255-8769 

mai  I  to :  i  obn  .rei  sing@,wpaffa.  af.mil 

Dr.  Reising  was  contacted  on  his  work  with  touch  selection  technologies.  He  has  worked 
with  touch  displays  and  tested  the  proximity  algorithm  that  Dr.  Osga  developed  in  a  3D  presentation 
type  format.  This  technology  can  be  used  in  aircraft,  ships,  tanks  or  ground  based  control  displays. 
He  has  had  his  studies  patented  for  use  by  the  Navy  and  has  models  and  demos  available  for  the 
touch  selection  display  screens.  They  have  been  developed  through  algorithms  made  from  off-the- 
shelf  technologies. 

5.  Contact  Information:  Dr.  Grant  McMillan 

HFRL/HEC 

Human  Effectiveness  Directorate 
2255  H  Street 
WPAFB,  OH  45433 
Phone:  (937)  255-8766 
mailto:grant.mcmillan@wDafb.af.mil 

Dr.  McMillan  has  been  working  on  a  Phase  II  SBIR  with  Sytronics  that  is  integrating  head 
tracking  and  speech  recognition  for  hands-free  interaction  with  a  wearable  computer.  The  head 
tracker  is  used  for  cursor  control  on  the  head-mounted  display  of  a  wearable  computer.  Speech 
recognition  is  used  to  issue  discrete  commands  and  to  navigate  through  menus.  Target  users  include 
maintenance  technicians,  inventory  control  personnel,  medical  personnel  operating  in  field 
environments,  and  anyone  else  who  need  hands-free  access  to  critical  information  sources. 

6.  Contact  Information:  CAPT  Angus  Rupert,  MC  USN,  M.D.,  Ph.D. 

U.S.  Naval  Aeromedical  Research  Laboratory 
Pensacola,  FL  32508-1046 
Phone:  (850)  452-4496 

HSIAC  was  able  to  contact  an  associate  of  CAPT  Rupert,  who  works  for  the  Naval 
Aeromedical  Research  Laboratory  to  give  us  information  on  the  TSAS.  The  TSAS  is  being 
developed  currently  and  will  be  used  for  V-22  Osprey  pilots  to  help  detect  the  movements  of  the 
aircraft  by  sensors  felt  on  their  body  through  the  vest.  Additional  information  can  be  found  at 
<httD://www.namrl.navv.mil/accel/TSAS/index.htm>. 
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7.  Contact  Information:  Kenneth  Wauchope 

Navy  Center  for  Applied  Research  in  Artificial  Intelligence  (NCARAI) 
Naval  Research  Laboratory,  Code  5512 
Washington,  DC  20375-5337 
Phone:  (202)  767-9004 

mailto:wauchope@.aic.nrl.navv.mil. 

Mr.  Wauchope  has  been  working  on  multimodal  interface  concept  demonstrations  for  the 
Navy  by  adding  speech  or  spoken  natural  language  I/O  to  existing  military  applications,  integrating 
as  much  as  possible  with  the  existing  graphical  user  interface.  These  applications  have  included 
KOALAS  (NAVAIR  command  &  control  simulation),  VIEWER  (NRL  virtual  reality  stealth  viewer), 
LACE  (Air  Force  combat  simulation  with  cartographic  database),  QuickSet  (Oregon  Graduate 
Institute  multimodal  interface),  Battlespace  Visualization  Tool  (Marine  Corps  situational  awareness 
software),  and  GIDB  (NRL  Stennis's  geographic  information  database).  The  BVT  speech  interface 
for  the  Marines  sounds  like  it  might  be  a  good  match  for  the  ARL/HRED  crew  station  operations 
task.  Their  objective  was  to  allow  a  soldier  to  operate  GUI-based  software  on  a  portable  or  wearable 
computer  by  voice  only,  either  eyes-engaged  or  eyes-busy.  The  same  interface  has  been  installed  on 
desktop  machines  in  a  command  center  during  recent  Marine  exercises.  At  any  time  the  user  is  free 
to  use  either  GUI  or  speech  to  navigate  the  system  and  fill  in  message  templates.  There  is  no  natural 
language  processing  involved,  just  a  highly  extensible  integration  of  speech  commands  with  Java 
Swing  graphics  using  the  Java  Speech  API.  The  multimodal  research  that  Mr.  Wauchope  has  been 
impressed  with  lately  is  QuickSet  and  its  agent-based  architecture  and  unification-based  approach  to 
multimodal  integration.  One  possible  research  direction  they  are  moving  towards  is  "perceptual  user 
interfaces"  which  detect  user  behaviors  that  are  not  intentional  inputs  or  commands  to  the  system. 

8.  Contact  Information:  Linda  Sibert 

Code  5513 

Naval  Research  Laboratory 
4555  Overlook  Avenue,  SW 
Washington,  DC  20375-5337 
Phone:  (202)767-0824 
Fax:  (202)  4044080 
mailto:sibert@,itd.m'l.navv.mil 

Ms.  Sibert  was  involved  with  eye  tracking  work  and  compiled  a  paper  titled.  Evaluation  of 
Eye  Gaze  Interaction.  The  paper  describes  her  work  on  testing  eye  behavior  and  eye  gaze  interaction 
algorithm  development.  Another  point  of  interest  is  work  that  is  being  done  by  her  colleague,  Jim 
Templeman.  The  Immersive  Simulation  Lab  at  Naval  Research  Laboratory  is  developing  a  new 
virtual  locomotion  technique  named  "Gaiter"  that  allows  a  person  to  move  in  a  natural  way  through  a 
virtual  environment  (VE).  Their  approach  adopts  walking  in  place  as  the  basis  for  virtual 
locomotion.  Walking  and  running  in  place  are  expressive  gestures  that  exhibit  many  of  the  attributes 
of  natural  human  gate.  In-place  stepping  allows  people  to  turn  and  change  posture  in  a  natural 
manner.  Gaiter  is  part  of  a  personnel  simulator  to  train  Marines  in  close  quarters  combat  that  is 
being  developed  by  the  VIRTE  program  at  the  Office  of  Naval  Research. 
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9.  Contact  Information:  Dave  Williamson 
AFRL/HECA 
2255  H  Street 
WPAFB,  OH  45433 
Phone:(937)255-7593 
mailto:david.williamson@wpafb.af.mil 

Mr.  Williamson  is  involved  with  a  speech  recognition  technologies  that  are  at  a  very  high 
level  maturity.  One  is  called  Tabtalk  and  will  be  used  for  the  command  and  control  center  of  a 
battleship.  It  is  set  up  for  a  data  entry  operator  to  build  up  the  linguistics  in  30-40%  of  the  time.  The 
fielding  of  this  project  will  hopefully  be  in  the  next  year.  This  is  based  from  off  the  shelf 
technologies  through  Nuance  Communications,  which  tries  to  simulate  natural  speech  language 
capabilities  and  is  speaker  independent,  in  a  noisy  environment.  They  are  also  working  on  HES, 
which  is  speech  technology  over  FM  radios  and  is  for  a  flight  line  application.  Another  technology 
mentioned  is  the  Strike  Helmet  21,  which  is  for  the  F-15  and  will  be  used  for  these  airborne 
applications.  It  is  a  combination  of  speech  recognition  with  a  helmet  mounted  display.  It  is  foreseen 
to  be  at  a  fielding  maturity  level  in  four  to  five  years.  There  has  also  been  recent  efforts  put  forth  to 
work  with  the  test  pilot  school  to  combine  ITT  Command  Voice  and  a  boxware  system  for  the  F-16 
called  VSTA. 

The  Alternative  Control  and  Display  Technology  Matrix  found  in  Appendix  B  was  used  to 
compile  and  summarize  the  results  of  the  SME/Source  Survey  effort.  Within  this  matrix  you  will  find 
technology  descriptions,  additional  point  of  contact  and/or  web  source  information,  estimated 
maturity  level,  and  perceived  technology  benefits  to  the  warfighter  as  indicated  within  the  product 
description. 
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4.  CONCLUSIONS* 

Future  Army  crew  stations  will  inevitably  have  more  complex  technology  to  cope  with  more 
demanding  operational  scenarios.  There  will  need  to  be  a  corresponding  advance  in  the  way  that  the 
warfighter  interfaces  with  systems  to  enable  efficient  control  and  information  transfer.  The  benefits 
of  alternative  control/display  technologies  presumably  lie  in  a  more  natural  interface  with  the 
platform  and  the  potential  for  improvements  in  the  speed  of  operation  while  reducing  training 
overhead. 

Optimizing  crew  station  design  by  introduction  of  alternative  controls  and  displays  would 
mean  considering  cost  issues  at  two  levels: 

1 .  For  the  user,  the  aim  of  alternative  technology  should  be  to  minimize  the  cost  of  control  by 
making  the  best  use  of  limited  human  resources  and  increasing  the  global  effectiveness  of 
human-machine  coupling; 

2.  For  the  Defense  community,  the  smart  integration  of  these  new  control  technologies  should 
result  in  training  cost  reduction,  increased  operational  effectiveness  and,  eventually,  crew 
station  simplification. 

Of  the  more  mature  alternative  technologies,  ASR  and  head-based  are  both  in  operational  use 
and  experimental  use-depending  upon  the  level  of  sophistication  of  the  technology-and  are  both 
technically  mature  enough  now  for  full  operational  use,  with  research  on  the  next  generation,  higher 
capability,  systems  in  progress. 

Eye-based  control  is  laboratory  mature  and  is  used  for  assessing  eye  movement  in  simulators. 
With  further  development  it  has  the  potential  to  integrate  effectively  in  the  operational  environment 
with  head-  and  voice-based  control.  It  may  enable  a  range  of  potentially  useful  explicit  and  implicit 
control  functions.  The  technology  is  not  yet  mature  enough  for  complete  integration  into  the 
operational  environment,  but  the  necessary  advances  can  probably  be  made  in  the  near  (two  to  four 
yrs)  to  mid  term  (four  to  seven  yrs).  Gesture  and  biopotential  are  probably  the  least  mature,  but 
provide  potential  for  future  generation  systems  (2020). 

Virtual  retinal  displays  (VRD),  tactile  vests,  and  volumetric  displays  were  also  discussed. 
VRDs  and  tactile  vests  are  somewhat  mature  technologies  being  implemented  in  a  limited  fashion  or 
being  demonstrated  operationally  within  the  DoD.  Volumetric  displays  appear  useful  in  presenting 
large  volumes  of  3D  data  that  may  be  useful  in  command  and  control  environments  but  appears  to 
have  limitations  that  will  prevent  their  effective  near-term  use  in  Army  crew  stations. 

The  most  evident  need  is  to  be  able  to  calibrate  the  appropriate  system  to  match  the  possible 
mixture  of  voice,  eye,  hand  gesture  and  cortical  response  characteristics  of  the  user  to  optimize 
accuracy  and  reliability  in  multisensory  systems. 

Quite  likely,  the  major  difficulty  in  integrating  alternative  controls  and  displays  more 
extensively  into  crew  station  design  will  arise  from  the  unique  adaptive  ability  of  the  human  being. 
Among  individuals,  various  strategies  using  various  modalities  will  be  developed  to  successfully 
perform  a  similar  task.  From  an  engineering  point  of  view,  the  challenge,  therefore,  will  be  to 
determine  among  the  various  technologies  and  combination  possibilities  what  to  do,  and  why  and 
how  to  implement  it  at  the  lowest  human  and  economical  cost. 

It  appears  a  noticeable  amount  of  work  remains  to  be  done  by  researchers  and  engineers  both 
in  the  human  factors  and  engineering  domains  to  prove  and  provide  the  benefits  that  might  be  gained 
by  integrating  alternative  technologies  into  future  crew  station  environments.  Integration  of  these 


*  Primarily  drawn  from  Rood,  G.  M.  (1998).  Operational  rationale  and  related  issues  for  alternative  control 
technologies.  In  Alternative  control  technologies:  Human  factors  issues  (RTO-EN-3).  Neuilly-Sur-Seine 
Cedex,  France:  North  Atlantic  Treaty  Organization,  Research  and  Technology  Organization. 
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technologies  requires  more  than  putting  boxes  side  by  side  and  physical  connection  to  the  Army 
platform.  Achieving  a  meaningful  and  smart  implementation  of  these  technologies  will  require  a 
synergistic  effort  involving  research  labs,  system  manufacturers  and  equipment  makers. 
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7,  APPENDIX  A:  LITERATURE  SEARCH  STRATEGY 

Literature  Review  Support  to  the  Human  Research  and  Engineering  Directorate 

U.S.  Army  Research  Laboratory 

Status  Update  of  Alternative  Control  and  Display  Technologies 
Background 

This  Human  Systems  lAC  (HSIAC)  Subscription  Account  Work  Plan  provides  support  to  the  Human 
Research  and  Engineering  Directorate  of  the  U.S.  Army  Research  Laboratory  (ARL)  and  addresses 
Human  Factors  Engineering  research  questions  associated  with  nontraditional  or  alternative 
information  processing  controls  and  displays.  The  integration  of  advanced  technologies  into  Army 
systems  has  the  potential  for  making  soldier  operation  of  these  systems  more  efficient  and  effective, 
as  well  as  providing  the  soldier  with  greater  situational  awareness  at  lower  levels  of  cognitive 
workload.  Some  of  these  technologies,  known  as  alternative  control  and  display  technologies, 
involve  the  aiding  or  augmentation  of  information  to  and  from  the  soldier  by  nontraditional 
modalities,  so  that  the  soldier  can  respond  more  quickly  to  the  demands  of  the  battlefield  within  the 
crew  station  (ground  and  air)  environment.  ARL  performs  research  exploring  the  integration  of 
advanced/altemative  information  technologies  within  Army  crew  systems.  However,  ARL  needs  to 
be  appraised  of  current  and/or  developmental  alternative  control  and  display  technologies  and 
identify  when  they  might  be  available. 


Tasking 

HSIAC  will  perform  a  literature  search  and  contact  subject  matter  experts  to  determine  the  status  of 
advanced/altemative  controls  and  displays.  HSIAC  will  identify  these  technologies  and  assess  their 
relevance  to  the  improvement  of  soldier  performance.  Potential  alternative  display  technologies  may 
include,  but  are  not  limited  to,  helmet  mounted  displays  (HMDs),  tactile  vests,  virtual  retinal 
displays,  and  spatial  auditory  displays.  Potential  alternative  control  technologies  may  include,  but  are 
not  limited  to,  voice-based  (speech  recognition),  gaze-based,  gesture-based,  head-based,  and 
biopotential-based  controls. 


Suggested  Search  Terms/Strategy 

control(s)/control(s)  coding 
control  system(s) 

alternative/ advanced 
voice-based  (speech  recognition) 
gaze-based  (head/eye  coupled) 
gesture-based 
head-based 
biopotential-based 
physiology(ical)-based 
sound  activated 
comparison/selection  among 
display(s)/display(s)  coding 
display  system(s) 

alternative/ advanced 
helmet  mounted  (HMD) 
tactile  display/tactile  vest 
haptic  display(s) 
retinal 

spatial  auditory  (3D  audio) 

projected 

stereoscopic  (3D) 

Comparison/selection  among 


and  ground  vehicles 

aircraft/rotorcraft 
human  factors  (engineering) 
avionics 

human  performance 
flight/navigation  instrumentation 
information/information  technology 
crew  stations/systems 
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8.  APPENDIX  B:  ALTERNATIVE  CONTROL  AND  DISPLAY  TECHNOLOGY  MATRIX 


personnel,  medical  personnel 

_ operating  in  field  environments,  etc. 

Head  control  unit  VA  Medical  Center  Phase  l-ll  Vehicle  cockpit  control  The  VA  R&D  developed  Ultrasonic 

_  Office  of  Technology  Transfer _ Head  Control  Unit  as  an  add-on 
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9.  APPENDIX  C:  NONCOPYRIGHTED  SEARCH  RESULTS 
ORDERING  DOCUMENTS 

9.1  DEFENSE  TECHNICAL  INFORMATION  CENTER  (DTIC) 

DTIC  is  the  central  repository  for  documents  resulting  from  research  supported  by  the 
Department  of  Defense  (DoD).  DTIC  maintains  several  databases,  including  Technical  Report  (TR) 
database,  Technical  Effort  and  Management  System  (TEAMS)  Database,  and  Independent  Research 
and  Development  (IR&D)  Databases. 

Documents  from  the  DTIC  TR  database  (including  documents  from  the  DTIC  CD-ROM)  are 
identified  by  an  accession  number  that  begins  with  "AD,"  such  as  AD-A123  456.  Most  of  these 
documents  are  available  through  DTIC.  Some  of  the  documents  may  not  be  available  through  DTIC; 
however,  the  citations  for  these  documents  contain  the  necessary  document  acquisition  information. 

To  order  DTIC  documents,  organizations  must  have  a  deposit  account  established  with  the 
National  Technical  Information  Service  (NTIS,  see  below),  against  which  document  ordering  fees 
will  be  charged.  Call  DTIC  if  you  do  not  have  information  on  establishing  a  deposit  account  with 
NTIS.  When  ordering  documents  from  DTIC,  please  cite  your  DTIC  User  Code. 

Defense  Technical  Information  Center 
Reference  and  Retrieval  Division  (DTIC-BR) 

8725  John  J.  Kingman  Road,  Suite  0944 

Ft.  Belvoir,  VA  22060-6218 

Telephone:  (703)  767-8274  /  DSN  427-8274 

1-800-CAL-DTIC  (225-3842),  menu  selection  1 

FAX:  (703)  767-9070  /  DSN  427-9070 

mailto:msorders@dtic.mil 

http://www.dtic.dla.mil/dtic/docorder.html 

9.2  NATIONAL  TECHNICAL  INFORMATION  SERVICE  (NTIS) 

NTIS  is  a  major  source  for  US  and  foreign  government-sponsored  research  documentation. 
Orders  for  NTIS  documents  can  be  charged  to  an  NTIS  Deposit  Accoxmt,  American  Express,  Visa,  or 
MasterCard.  For  additional  information  on  establishing  a  deposit  accoimt,  you  may  contact  NTIS 
directly  at  (703)  487-4064.  NTIS  document  orders  may  also  be  placed  using  the  following 
information: 


Telephone  Orders:  8:30-5:50  EST  (703)487-4650 
Mailorders:  NTIS,  Springfield  VA  22161 
FAX  Orders:  (703)321-8547 
For  Assistance:  (703)  487-4679 
mailto:orders@,ntis.fedworld.gov. 
httD://www.fedworld.gov/ntis/ntishome.html 
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9.3  HUMAN  SYSTEMS  INFORMATION  ANALYSIS  CENTER  (HSIAC) 

We  recommend  that  you  discuss  potential  document  orders  with  your  in-house  or  local 
technical  information  specialist.  He  or  she  will  know  the  most  appropriate  method  to  place  orders 
for  documents  identified  in  this  report.  If  questions  do  arise,  please  feel  free  to  contact  the  Human 
Systems  Information  Analysis  Center  (HSIAC)  at  the  address  below. 

AFRL/HEC/HSIAC 

2261  Monahan  Way,  Bldg.  196 

Wright-Patterson  AFB,  OH  45433-7022 

Phone:  (937)255-4842 

FAX:  (937)2554823 

mailto  :hsiac@wpafb.af  mil 

httD://iac.dtic.mil/hsiac 
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AN  (1) 
CA  (5) 
TI  (6) 

DN  (9) 
AU  (10) 


RD  (11) 
PG  (12) 
RS  (14) 
RN  (18) 

RC  (20) 
AL  (22) 


DE  (23) 


ID  (25) 
AB  (27) 


AN  (1) 
CA  (5) 
TI  (6) 

RD  (11) 
PG  (12) 
RC  (20) 
NO  (21) 

DE  (23) 


ID  (25) 
AB  (27) 


AD~B176  165/XAG 

MIDWEST  SYSTEMS  RESEARCH  INC  DAYTON  OH 

Pilot  Factors  Research  for  Crew  Systems  Development, 

Final  rept .  1  Mar  89-1  Mar  93 
Andes,  William  S. 

Barry,  Timothy 
Hartsock,  David 
Kovacs,  John  A. 

Lovering,  Peter  B. 

Sep  1993 
80  Pages 

MSR-FR-93-12 600-01 

WL*-TR-93-3079 

XC-WL/WP 

Unclassified  report 

Distribution  authorized  to  U.S.  Gov't,  agencies  and  their  contractors; 
Critical  Technology;  Sep  93.  Other  requests  shall  be  referred  to 
WL/FIPT,  Wright-Patterson  AFB,  OH  45433-7562.  This  document  contains 
export-controlled  technical  data. 

*PILOTS,  ’'^FLIGHT  CREWS,  *HUMAN  FACTORS  ENGINEERING,  *FLIGHT  SIMULATION 
AIR  FORCE,  AIRCRAFT,  ATTITUDE  INDICATORS,  AUTOMATION,  COCKPITS, 
CONTRACTS,  CONTROL,  CREWS,  DATA  LINKS,  DOCUMENTS,  DYNAMICS,  FLIGHT 
TESTING,  HEAD (ANATOMY) ,  IMPACT,  INDICATORS,  INTERFACES,  LABORATORIES, 
NAVIGATION,  OHIO,  OPERATION,  PHOTOMETERS,  RECOGNITION,  RECOVERY,  SKY, 
STATIONS,  SWITCHES,  TACTICAL  AIRCRAFT,  TRANSPORT  AIRCRAFT,  WORKLOAD, 
COMPUTER  ARCHITECTURE 

EXPORT  CONTROL,  PE62201F,  WUWL24030498 

The  contents  of  this  final  report  are  provided  as  a  summary  of 
documented  cockpit  design  efforts  performed  by  Midwest  System  Research, 
Inc.,  between  March  1989  and  March  1993,  for  the  United  States  Air 
Force  at  the  Wright  Laboratory.,  Joint  Cockpit  Office,  Wright  Patterson 
Air  Force  Base,  Ohio.  The  work  was  performed  under  contract  F3361588-C- 
3612,  Pilot  Factors  Research  for  Crew  Systems  Development  (PIFAX) .  This 
report  summarizes  all  work  accomplished  on  the  contract  over  a  52 -month 
period.  More  task  specific,  detailed  information  is  contained  in  final 
reports  and  other  documents  for  each  task.  S\ammary  information  is 
provided  pertaining  to  work  efforts  in  the  following  areas:  MAGIC 
(Micro-Controller  Enhanced  Tri-Sensor  Photometer,  Super  Switch,  Font 
Studies,  Unusual  Attitude  Recovery  Studies,  3-D  Cursor  Studies,  Head 
Down  Display/Standardized  Primary  Flight  Display,  Standardized  Military 
HUD,  Voice  Recognition,  Pathway- In-The-Sky  Navigation,  and  Bezel 
Attitude  Indicator  Studies)  Generic  Voice  Interface  Workstation 
Development;  C-17  Crew  Station  Design/Evaluation  Support;  Tactical 
Aircraft  Cockpit;  Transport  Aircraft  Cockpit;  FAA  Mode-S  Data  Link; 
Adaptive  Automation  Support;  SOF  Simulation  Architecture  Definition; 
Control  and  Display  Criteria;  and  Modeling  the  Dynamics  of  Mental 
Workload  and  Pilot  Performance.  Pilot,  HUD,  HDD,  Pilot  factors,  ICASS, 
TACS,  IMPACT,  TRAC,  MAGIC,  C-17,  SOF,  Data  link,  Mode-S,  Cockpit, 
Special  Operations,  SOA,  Voice,  Adaptive  automation.  Simulation 
architecture . 

AD-A150  044/XAG 

NAVAL  AIR  TEST  CENTER  PATUXENT  RIVER  MD 

Advanced  Aircrew  Display  Symposium  Proceedings  (6th)  Held  at  Patuxent 
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The  recent  proliferation  of  new  color  display  applications  can  be 
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traced  to  two  interrelated  trends:  1)  a  growing  interest  in  the 
potential  advantages  of  a  color  information  display  for  enhancing  human 
performance  in  complex  man-machine  systems;  and  2)  the  availability  of 
a  rapidly  evolving  display  technology  to  support  advanced  color  display 
concepts.  Table  of  Contents:  A  Systematic  Program  for  the  Development 
and  Evaluation  of  Airborne  Color  Display  Systems  by  L.  Silverstein, 
Airborne  Electronic  Color  Displays  -  A  Review  of  UK  Activity  Since  1981 
by  R.  Caldow,  Color  CRT  in  the  F-15  by  J.  Turner  and  H.  H  Waruszewski, 
Integration  of  Sensor  and  Display  Subsystems  by  D.  Bohrer  and  P. 
Jenkins,  Modernizing  Engine  Displays  by  E.  Schneider  and  E.  Enevoldson, 
Colored  Displays  for  Combat  Aircraft  by  C.  Maureau,  Display  Technology 
and  the  Role  of  Human  Factors  by  S.  Roscoe,  J.  Tatro,  and  E.  Trujillo, 
Pictorial  Format  Program:  Past,  Present,  and  Future  by  G.  Lizza,  J. 
Reising,  and  L.  Hitchcock,  The  Command  Flight  Path  Display  -  All 
Weather,  All  Missions  by  G.  Hoover,  S.  Shelley,  V.  Cronauer,  and  S. 
Filarsky,  Sensor-Coupled  Vision  Systems  by  T.  Stinnett,  An  Argument  for 
Standardization  in  Modern  Aircraft  Crew  Stations  by  V.  Devino. 
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This  article  is  from  'Advanced  Concepts  for  Avionics /Weapon  System 
Design,  Development  and  Integration:  Conference  Proceedings  of  the 
Avionics  Panel  Symposium  (45th)  Held  at  Ottawa,  Canada  on  18-22  April 
1983,'  AD-A138  600,  p9-l-9-9. 

*Avionics,  *Display  systems,  *Man  machine  systems 
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Flight  control  systems,  Human  factors  engineering.  Bus  conductors. 
Multiplexing,  Video  signals.  Digital  systems.  Modules (Electronics ) , 

Data  management,  Life  cycle  costs 
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Crew  stations,  AIDS (Advanced  Integrated  Display  System),  NATO 
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The  U.S.  Navy  has  been  encouraging  advanced  development  concepts  aimed 
at  increasing  the  aircraft  instrumentation  performance  for 
multi-platform  application  of  1990 's  weapons  systems.  The  system 
integration  (R&D)  objectives  are  to  produce  a  system  architecture 
easily  adaptable  to  many  platforms;  technology  objectives  are  to 
determine  the  state  of  the  art  for  displays,  electronics,  and  controls; 
and  the  human  factors  objectives  are  to  determine  the  proper 
human-machine  interfaces  so  that  the  ultimate  crew  station  will  be 
capable  of  providing  the  pilot  with  the  proper  display  and  controls 
performance  to  satisfy  the  diverse  requirements  of  fighter,  attack, 

ASW,  fixed-wing,  rotary-wing,  and  V/STOL  platforms  in  both  a  one-man 
crew  of  two-man  crew  matrix.  All  data/control  interfaces  among  units  of 
this  crew  station  system  and  other  platforms  subsystems  will  be  via 
digital  data  buses  and  video  multiplex  buses.  No  individual  discrete 
signal,  data,  or  control  lines  will  be  needed.  This  paper  discusses  the 
six  interfaces  necessary  to  ensure  the  optimum  development  of  this  crew 
station,  the  predicted  platform  mission  improvements,  and  the  requisite 
life-cycle  cost  considerations.  This  concept  will  serve  as  a  basis  for 
planning  the  integration  of  the  necessary  hardware  and  software 
features  in  current  and  future  weapons  systems . 
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AB  (27)  This  issue  contains  articles  on  the  following  subjects:  1, Cognitive 
Engineering:  A  Different  Approach  to  Human-Machine  Systems; 

2  .Brain-Actuated  Control:  Thinking  Ahead  to  ’’Firefox"  ;  3.  A  Conversation 
with  Grant  McMillan;  4. National  Air  Intelligence  Center:  Human  Factors 
Analysis  of  Crew  Stations  CSERIACts  objective  is  to  acquire,  analyze, 
and  disseminate  timely  information  on  crew  system,  ergonomics  (CSE) . 

The  domain  of  CSE  includes  scientific  and  technical  knowledge  and  data 
concerning  human  characteristics,  abilities,  limitations,  physiological 
needs,  performance,  body  dimensions,  biomedical  dynamics,  strength  and 
tolerances.  It  also  encompasses  engineering  and  design  data  concerning 
equipment  intended  to  he  used,  operated,  or  controlled  by  crew  members. 
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AB  (27)  The  contents  of  this  final  report  are  provided  as  a  summary  of 

documented  cockpit  design  efforts  performed  by  Midwest  System  Research, 
Inc.,  between  March  1989  and  March  1993,  for  the  United  States  Air 
Force  at  the  Wright  Laboratory.,  Joint  Cockpit  Office,  Wright  Patterson 
Air  Force  Base,  Ohio.  The  work  was  performed  under  contract  F3361588-C- 
3612,  Pilot  Factors  Research  for  Crew  Systems  Development  (PIFAX) .  This 
report  summarizes  all  work  accomplished  on  the  contract  over  a  52 -month 
period.  More  task  specific,  detailed  information  is  contained  in  final 
reports  and  other  documents  for  each  task.  Summary  information  is 
provided  pertaining  to  work  efforts  in  the  following  areas:  MAGIC 
(Micro-Controller  Enhanced  Tri-Sensor  Photometer,  Super  Switch,  Font 
Studies,  Unusual  Attitude  Recovery  Studies,  3-D  Cursor  Studies,  Head 
Down  Display/Standardized  Primary  Flight  Display,  Standardized  Military 
HUD,  Voice  Recognition,  Pathway- In- The -Sky  Navigation,  and  Bezel 
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Control  and  Display  Criteria;  and  Modeling  the  Dynamics  of  Mental 
Workload  and  Pilot  Performance.  Pilot,  HUD,  HDD,  Pilot  factors,  ICASS, 
TACS,  IMPACT,  TRAC,  MAGIC,  C-17,  SOF,  Data  link,  Mode-S,  Cockpit, 
Special  Operations,  SOA,  Voice,  Adaptive  automation.  Simulation 
architecture . 
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AB  (27)  This  thesis  details  the  engineering  design  of  a  personal, 
computer-based  system,  which  is  intended  to  support  a 
hands-eyes-ears-f ree  Personal  Navigational  and  Communication  System 
(PNCS) .  This  computer-based  system  is  designed  to  be  used  with  COTS 
devices,  such  as,  (1)  a  GPS  receiver,  (2)  a  laptop  or  desktop  computer, 
(3)  a  rechargeable,  long-life  battery  pack,  and  (4)  a  wearable  tactile 
communications  vest.  The  vest  is  currently  under  development  by  the 
Naval  Aerospace  Medical  Research  Lab  (NAMRL)  and  together  with  this 
computer-based  system  can  provide  a  complete  hands-free  personal 
navigational  and  communication  system.  The  intent  of  the  navigation 
system  is  to  satisfy  both  commercial  and  milita  uses  for  land-based 
edestrian  and  vehicular  travel. 
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AB  (27)  The  contents  of  this  final  report  are  provided  as  a  summary  of 

documented  cockpit  design  efforts  performed  by  Midwest  System  Research, 
Inc.,  between  March  1989  and  March  1993,  for  the  United  States  Air 
Force  at  the  Wright  Laboratory.,  Joint  Cockpit  Office,  Wright  Patterson 
Air  Force  Base,  Ohio.  The  work  was  performed  under  contract  F3361588-C- 
3612,  Pilot  Factors  Research  for  Crew  Systems  Development  (PIFAX) .  This 
report  summarizes  all  work  accomplished  on  the  contract  over  a  52 -month 
period.  More  task  specific,  detailed  information  is  contained  in  final 
reports  and  other  documents  for  each  task.  Summary  information  is 
provided  pertaining  to  work  efforts  in  the  following  areas:  MAGIC 
(Micro-Controller  Enhanced  Tri-Sensor  Photometer,  Super  Switch,  Font 
Studies,  Unusual  Attitude  Recovery  Studies,  3-D  Cursor  Studies,  Head 
Down  Display/Standardized  Primairy  Flight  Display,  Standardized  Military 
HUD,  Voice  Recognition,  Pathway- In- The-Sky  Navigation,  and  Bezel 
Attitude  Indicator  Studies)  Generic  Voice  Interface  Workstation 
Development;  C-17  Crew  Station  Design/Evaluation  Support;  Tactical 
Aircraft  Cockpit;  Transport  Aircraft  Cockpit;  FAA  Mode-S  Data  Link; 
Adaptive  Automation  Support;  SOF  Simulation  Architecture  Definition ; 
Control  and  Display  Criteria;  and  Modeling  the  Dynamics  of  Mental 
Workload  and  Pilot  Performance.  Pilot,  HUD,  HDD,  Pilot  factors,  ICASS, 
TACS,  IMPACT,  TRAC,  MAGIC,  C-17,  SOF,  Data  link,  Mode-S,  Cockpit, 
Special  Operations,  SOA,  Voice,  Adaptive  automation.  Simulation 
architecture . 
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*AUDITORY  SIGNALS,  *COCKPITS,  *MAN  COMPUTER  INTERFACE 
COMPUTERS,  COUPLINGS,  CREWS,  ENVIRONMENTS,  HUMANS,  INTERFACES, 
LABORATORIES,  MACHINES,  MEASUREMENT,  MEDICAL  RESEARCH,  METHODOLOGY, 
MODELS,  PERFORMANCE (HUMAN) ,  PERSONNEL,  PILOTS,  PROTOTYPES,  SIGNALS, 
SIMULATION,  STATE  OF  THE  ART,  STATIONS,  VISUAL  SIGNALS,  WORK 
PE62202F,  WUAL71842611 

This  report  describes  the  work  performed  by  MacAulay-Brown,  Inc.  (MacB) 
to  support  the  Armstrong  Aerospace  Medical  Research  Laboratory  (AAMRL) 
Pilot-Centric  Design  Methodology  and  Concepts  (PDMC)  Program.  The  PDMC 
Program  was  established  to  respond  to  the  need  for  operator-centered 
crew  stations.  The  conceptual  development  of  virtual-world 
technologies,  providing  a  spatial  coupling  to  the  visual,  aural,  and 
tactile  senses,  was  emphasized  during  the  program.  This  report  details 
studies,  analyses,  simulations,  and  hardware /software  prototype 
evaluations  performed  by  MacB  and  various  subcontracted  personnel,  in 
order  to  develop  measurements  and  models  of  human  performance  in 
tactical  and/or  strategic  environments.  In  addition,  the  report 
describes  assessments  of  state-of-the-art  human/machine  (sub)  systems 
relating  to  pilot-centered  cockpit  interfaces  and  various  conceptual 
and  hardware /software  development  efforts  conducted  within  the  PDMC 
program.  Auditory  signals.  Cockpits,  Display,  Man-computer  interface. 
Performance,  Visual  signals. 
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AB  (27)  The  Tactical  Aircraft  Cockpit  Study  (TACS)  Phase  II  evaluation  assessed 
pilot  performance  and  preference  using  three  types  of  data  input 
techniques:  hands  on  throttle  and  stick  (HOTAS)  touch-sensitive  CRT 
screens  and  voice  control .  These  techniques  were  analyzed  within  the 
framework  of  a  mid-to-late  1990'  tactical  air-superiority  fighter's 
mission  requirements  and  projected  cockpit  technologies.  Other  design 
issues  examined  during  this  study  included  pilot  assessment  of  required 
system  automation,  the  use  of  an  articulating  seat  and  the  proper 
implementation  and  integration  of  advanced  display  technology  and  voice 
command.  The  report  is  divided  into  two  volumes.  The  first  (Switchology 
Investigation)  presents  the  procedures  and  results  of  the  evaluation 
and  the  cockpit  changes  recommended  by  the  evaluation  subjects.  The 
second  volume  (Pilot's  Handbook)  was  given  to  the  evaluation  subjects 
prior  to  the  role-playing  sessions  and  provided  the  material  necessary 
to  understand  the  operation  of  the  cockpit  and  its  capability. 

Keywords;  Advanced  tactical  fighter;  Cockpit  concepts;  Control 
execution;  Controls  and  displays;  Crew  station  design;  Display  formats, 
(sdw) 
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AB  (27)  Technological  advances  have  made  possible  the  development  of  system 

capabilities  which  allow  more  effective  weapon  system  operation  under 
difficult  conditions,  such  as  low  altitude,  high  speed,  night  and  all 
weather.  Higher  levels  of  technology  integration  and  combat  automation 
are  now  becoming  essential  to  enable  the  pilot  to  accomplish  the 
critical  functions  of  flight  path  control,  threat  management, 
navigation,  attack  engagement  and  weapon  system  management.  Several 
emerging  technologies  are  now  beginning  to  spawn  major  innovations  in 
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aircraft  design,  through  the  use  of  combat  automation  concepts.  These 
technologies  carry  significant  implications  in  respect  of  pilot 
workload,  situational  awareness,  crew  station  controls  and  displays, 
and  automated  system  functions  including  integrity  management. 

Effective  and  efficient  harmonisation  of  this  total  weapon  system, 
which  must  also  achieve  the  essential  features  of  pilot  acceptability 
and  safety,  is  critically  dependent  on  the  pilot/vehicle  interface. 

This  symposium  sought  to  address  these  critical  issues  of  combat 
automation  and  the  man-machine  interface.  In  particular,  it  considered 
the  major  implications  and  trade-offs  involved  in  varying  levels  of ^ 
airframe  and  weapon  systems  sophistication  and  such  fundamental  choices 
as  that  of  single  seat  versus  two  seat  operation.  Keywords:  Display 
systems;  Head  up  displays;  Aircrew  protective  headgear;  Fire  control 
systems;  Cockpit  controls.  (KT) 
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DN  (9)  Final  technical  rept.  Apr  83 -Oct  84 
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RC  (20)  Unclassified  report 
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DE  (23)  ^Flight  crews,  ^Display  systems 

Avionics,  Jet  fighters.  Mission  profiles.  Stations,  Military 
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ID  (25)  PE62204F,  WUAFWAL2 003 0934 

AB  (27)  The  DTACS  Final  Report  describes  the  study  which  explored  advanced 

display  techniques  and  their  effect  on  future  fighter/attack  aircraft 
crew  stations.  The  emphasis  was  placed  on  new  and  developing  technology 
with  applications  to  integrated  avionics  systems.  Future  mission 
requirements  were  reviewed,  display  requirements  were  established, 
display  technologies  were  reviewed,  an  initial  configuration  of  an 
advanced  display  was  made  and  a  plan  for  further  development  was  also 
prepared. 
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TI  (6)  Avionics/Crew  Station  Integration 
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RD  (11)  Oct  1983 

PG  (12)  9  Pages 

RC  (20)  Unclassified  report 

NO  (21)  This  article  is  from  'Advanced  Concepts  for  Avionics /Weapon  System 
Design,  Development  and  Integration:  Conference  Proceedings  of  the 
Avionics  Panel  Symposium  (45th)  Held  at  Ottawa,  Canada  on  18-22  April 
1983,’  AD-A138  600,  p9“l-9-9. 

DE  (23)  *Avionics,  *Display  systems,  *Man  machine  systems 

Cockpits,  Naval  aircraft.  Integrated  systems.  Interfaces,  Pilots, 
Flight  control  systems.  Human  factors  engineering.  Bus  conductors. 
Multiplexing,  Video  signals.  Digital  systems.  Modules (Electronics ) , 
Data  management.  Life  cycle  costs 

ID  (25)  Crew  stations,  AIDS (Advanced  Integrated  Display  System),  NATO 
furnished.  Component  Reports 

AB  (27)  The  U.S.  Navy  has  been  encouraging  advanced  development  concepts  aimed 
at  increasing  the  aircraft  instrumentation  performance  for 
multi-platform  application  of  1990 's  weapons  systems.  The  system 
integration  (R&D)  objectives  are  to  produce  a  system  architecture 


easily  adaptable  to  many  platforms;  technology  objectives  are  to 
determine  the  state  of  the  art  for  displays,  electronics,  and  controls; 
and  the  human  factors  objectives  are  to  determine  the  proper 
human-machine  interfaces  so  that  the  ultimate  crew  station  will  be 
capable  of  providing  the  pilot  with  the  proper  display  and  controls 
performance  to  satisfy  the  diverse  requirements  of  fighter,  attack, 

ASW,  fixed-wing,  rotary-wing,  and  V/STOL  platforms  in  both  a  one-man 
crew  of  two-man  crew  matrix.  All  data/control  interfaces  among  units  of 
this  crew  station  system  and  other  platforms  subsystems  will  be  via 
digital  data  buses  and  video  multiplex  buses.  No  individual  discrete 
signal,  data,  or  control  lines  will  be  needed.  This  paper  discusses  the 
six  interfaces  necessary  to  ensure  the  optimum  development  of  this  crew 
station,  the  predicted  platform  mission  improvements,  and  the  recpiisite 
life-cycle  cost  considerations.  This  concept  will  serve  as  a  basis  for 
planning  the  integration  of  the  necessary  hardware  and  software 
features  in  current  and  future  weapons  systems. 
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ARCHITECTURE 
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INFORMATION  EXCHANGE,  DISTRIBUTED  DATA  PROCESSING,  MODELS,  REAL  TIME, 
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AN  (1)  AD-A357  190/XAG 

CA  (5)  WRIGHT  STATE  UNIV  DAYTON  OH  DEPT  OF  PSYCHOLOGY 

TI  (6)  Instrumentation  to  Enhance  DoD-Relevant  Research  on  Cognitive  Workload 
in  UAVs,  Image,  Exploitation,  and  Spatial  Hearing. 

DN  (9)  Kept,  for  1  Mar  97-28  Feb  98 

AU  (10)  Gilkey,  Robert  H. 

RD  (11)  Feb  1998 

PG  (12)  10  Pages 
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CT  (15)  F49620-97-1-0118 
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XC-AFRL-SR-BL 

RC  (20)  Unclassified  report 

DE  (23)  *COMPUTERIZED  SIMULATION,  *DISPLAY  SYSTEMS,  *VIRTUAL  REALITY 

REAL  TIME,  TEST  EQUIPMENT,  INSTRUMENTATION,  INTERACTIVE  GRAPHICS, 
WORKLOAD,  STEREOSCOPIC  DISPLAY  SYSTEMS 

ID  (25)  * VERITAS (VIRTUAL  ENVIRONMENT  RESEARCH  INTERACTIVE  TECHNOLOGY  AND 

SIMULATION),  HAPTIC  DISPLAYS,  UAV (UNMANNED  AERIAL  VEHICLES),  AUDITORY 
DISPLAYS,  VISUAL  DISPLAYS 

AB  (27)  The  project  goals  have  been  to  provide  enhanced  real-time  graphics 

generation  capacity,  computational  power,  and  real-time  audio  signal 
processing  capability  for  the  Virtual  Environment  Research,  Interactive 
Technology,  And  Simulation  (VERITAS)  facility,  making  it  better  suited 
to  the  demands  of  DoD-relevant  research  projects  on  human  performance 
in  complex  environments.  VERITAS  is  owned  by  Wright  State  University, 
but  housed  at  Wright-Patterson  AFB.  It  includes  a  CAVE ( Trademark ) , 
which  is  an  immersive,  wide  f ield-of-view,  stereoscopic,  real-time 
interactive  display  system,  allowing  the  user  to  move  through  virtual 
environments  with  minimal  encumbrances.  The  CAVE ( Trademark )  is 
controlled  by  a  Silicon  Graphics  Onyx (trademark)  computer  with 
Inf initeReality (Trademark)  graphics.  The  high-fidelity  simulations  in 
this  facility  allow  a  variety  of  questions  related  to  human 
effectiveness  to  be  addressed.  The  DURIP  funds  were  used  to  purchase 
three,  high-performance  computer  subsystems:  a  multiprocessor 
computational  subsystem,  a  graphics  generation  subsystem,  and  an 
acoustics  generation  subsystem.  These  subsystems  provide  critical 
capabilities  for  computationally  intensive,  real-time-constrained 
applications,  including  simulation,  virtual  environments,  auditory  and 
visual  displays,  motor  control,  and  human  perception  and  cognition. 

This  instrumentation  has  supported  specific  funded  DoD  projects 
investigating:  (1)  display  and  control  representations  for  UAV 
operation,  and  (2)  binaural  and  spatial  hearing. 
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Wearable  Computers,  and  Augmented  and  Virtual  Reality  Displays. 
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AB  (27)  The  objective  of  the  grant  was  to  establish  a  research  laboratory  to 
design  and  evaluate  augmented  and  virtual  reality  environments, 
wearable  computers,  and  haptic  displays.  To  complete  these  objectives, 
SGI  workstations,  force  feedback  hand  controllers,  head-mounted 
displays,  wearable  computers,  a  large-screen  projection  system,  and  NT 
workstations  were  purchased. 
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CA  (5)  LOGICON  TECHNICAL  SERVICES  INC  DAYTON  OH 

TI  (6)  An  Evaluation  of  Advanced  Multisensory  Display  Concepts  for  use  in 
Future  Tactical  Aircraft. 
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RM  (18)  AL/CF-TR-1997-0049 
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RC  (20)  Unclassified  report 

NO  (21)  Prepared  in  cooperation  with  FCI  Associates,  Inc.,  Beavercreek,  OH 
45432. 

DE  (23)  *FLIGHT  TESTING,  *MULTISENSORS,  *TACTICAL  AIRCRAFT,  *HELMET  MOUNTED 
DISPLAYS,  *HEAD  UP  DISPLAYS 

SCENARIOS,  NATO,  STATIONS,  SIMULATION,  RATIOS,  SURVIVABILITY,  COCKPITS, 
FLIGHT  CREWS,  PERFORMANCE (HUMAN) ,  AIRBORNE,  INTERCEPTION,  PILOTS, 
ATTACK,  REPORTS,  TRACKING,  HUMAN  FACTORS  ENGINEERING,  THREE 
DIMENSIONAL,  AERIAL  WARFARE,  MISSIONS,  JET  FIGHTERS,  FLEETS ( SHIPS ) , 
LETHALITY,  WORKLOAD,  QUESTIONNAIRES,  AWARENESS,  AIR  TO  AIR 
ID  (25)  *HEAD  DOWN  DISPLAYS,  *HAPTIC  DISPLAYS,  F-15  AIRCRAFT,  F-16  AIRCRAFT, 
SITUATION  AWARENESS,  PE62202F,  WUAL71841901 
AB  (27)  Pilots  from  three  NATO  countries  participated  in  simulated  air  combat 
scenarios  in  which  they  either  flew  a  conventional  cockpit,  consisting 
of  F-16/F-15  type  cockpit  displays,  or  a  virtually-augmented  cockpit, 
consisting  of  advanced  head  down/head  up  displays,  helmet  mounted 
displays/trackers,  3  dimensional  auditory  displays,  and  haptic 
displays.  Pilots  flew  simulated  air  intercept  missions  against  a 
four-ship  ground  attack  group  supported  by  two  air  to  air  adversary 
fighters.  The  pilot  flying  the  principal  cockpit  was  instructed  to  try 
to  shoot  down  the  ground-attack  group  and  return  to  a  pre-defined  safe 
air  space  without  being  shot  down  by  adversary  aircraft.  The  degree  to 
which  pilot  performance  was  differentially  affected  by  the  conventional 
versus  virtually- augmented  cockpit  manipulation  was  assessed  using 
objective  and  subjective  measures  including  pilot-aircraft 
lethality/ survivability,  pilot  workload,  and  pilot  situation  awareness. 
Results  indicated  a  significant  advantage  for  the  virtually- augmented 
interface  condition  in  the  number  of  missions  won,  exchange  ratio, 
mission  length,  and  number  of  ground  strikes.  In  addition,  the 
performance  improvements  yielded  by  the  virtually- augmented  crew 
station  were  realized  with  enhanced  situation  awareness  and  a  reduction 
in  workload  compared  to  the  conventional  crew  station.  Furthermore, 
post  flight  debrief  questionnaires  produced  highly  favorable  subjective 
reports  from  pilots. 
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CA  (5)  IMMERSION  HUMAN  INTERFACE  CORP  SAN  JOSE  CA 

TI  (6)  Haptic  Interface  for  Virtual  Reality  Simulation  and  Training.  Phase  1. 
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RC  (20)  Unclassified  report 

DE  (23)  * INTERACTIVE  GRAPHICS,  *VIRTUAL  REALITY,  *MEDICAL  COMPUTER  APPLICATIONS 
MATHEMATICAL  MODELS,  COMPUTERIZED  SIMULATION,  SOFTWARE  ENGINEERING, 
SIMULATORS,  OPTIMIZATION,  COMPUTER  AIDED  DESIGN,  TRAINING,  LOW  COSTS, 
ONE  DIMENSIONAL,  RESOLUTION,  FEEDBACK,  COMPUTER  GRAPHICS,  MANUAL 
OPERATION,  VISUAL  PERCEPTION,  DATA  DISPLAYS,  MAN  COMPUTER  INTERFACE, 
DESIGN  CRITERIA,  SURGERY,  SENSES ( PHYSIOLOGY) ,  ANALGESIA 

ID  (25)  PE65502F,  WUAFOSRSTTRTS 

AB  (27)  Advances  in  graphic  display  technologies  have  made  virtual  reality  (VR) 
and  scientific  visualization  applications  accessible  to  a  wide  user 
population.  Unfortunately,  few  human  interface  tools  exist  to  allow 
users  to  interact  naturally  with  these  powerful  graphical  environments. 
To  address  this  need.  Immersion  Corporation  has  developed  a  user 
interface  mechanism  to  allow  natural  manual  interaction  with  3-D 
environments  which  provides  realistic  force  feedback  to  the  user. 

This  haphic  display  methodology  combines  high  fidelity,  low  cost,  and 
inherent  safety  to  allow  force  reflection  technology  to  become 
commercially  feasible.  The  long  term  objective  is  to  produce  a  3-D 
haptic  interface  for  virtual  environments.  Phase  1  focused  on  producing 
one-dimensional  haptic  interface  hardware  and  incorporating  this 
technology  into  a  real  world  VR  application.  Immersion  and  the  Ohio 
Supercomputer  Center  have  worked  together  to  produce  a  virtual 
simulation  of  epidural  analgesia,  a  medical  procedure  that  requires 
delicate  needle  insertions  into  the  spinal  column.  The  resulting  VR 
simulation  is  so  realistic  in  look  and  feel,  it  can  actually  be  used  as 
a  training  environment  to  teach  doctors  to  perform  the  dexterous  manual 
procedure,  allowing  them  to  learn  manual  technique  and  explore  the 
associated  physical  sensations  without  the  risks  or  costs  associated 
with  using  real  biological  specimens.  (AN) 
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AUGMENTATION,  DISPLAY  SYSTEMS,  DOCKING,  DOCKS,  DRUGS,  GLOBAL, 
INTERACTIONS,  MODELS,  MOLECULES,  PERCEPTION,  PROTEINS,  VISUAL  AIDS 
AB  (27)  We  began  in  1967  a  project  to  develop  a  Haptic  +  display  for  6-D  force 
fields  of  interacting  protein  molecules.  We  approached  it  in  four 
stages:  a  2-D  system,  a  3-D  system  tested  with  a  simple  task,  a  6-D 

system  tested  with  a  simple  task,  and  a  full  6-D  molecular  docking 

system,  our  initial  goal.  This  paper  summarizes  the  entire  project — the 
four  systems,  the  evaluation  experiments,  the  results,  and  our 
observations.  The  molecular  docking  system  results  are  new.  Our 
principal  conclusions  are:  Haptic  display  as  an  augmentation  to  visual 
display  can  improve  perception  and  understanding  both  of  force  field 
and  of  world  models  populated  with  impenetrable  objects.  Chemists  using 
GROPE-III  can  readily  reproduce  the  true  docking  positions  for  drugs 

whose  docking  is  known  (but  not  to  them)  and  can  find  very  good  docks 

for  drugs  whose  true  docks  are  unknown.  The  present  tool  promises  to 
yield  new  chemistry  research  results;  it  is  being  actively  used  by 
research  chemists,  (js) 
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RC  (20)  Unclassified  report 
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Mass.  Behavioral  Science  Div.  See  also  report  dated  Jan  73,  AD-757 
344. 

DE  (23)  ^Flight  control  systems,  ^Display  systems,  *Touch,  * Instrument  flight 
Control  panels,  Skin (Anatomy) ,  Senses (Physiology) ,  Perception, 
Stimulation ( Physiology) ,  Electric  current.  Vibration,  Intensity,  Pilots 

ID  (25)  *Tactile  instriimentation,  ^Tactile  display  systems 

AB  (27)  The  program  was  directed  towards  the  development  of  tactile  displays 
for  flight  control.  The  results  of  the  first  phase  of  this  program 
have  been  reported  in  the  August  '73  Final  Report  (AD-767  763).  The 
report  presents  a  description  of  an  improved  tactile  display  system  and 
its  evaluation  as  a  one  and  two  axis  error  display  instrument  during  a 
series  of  manual  tracking  experiments.  Both  electrotactors  and 
vibrotactors  arrays  were  used.  These  experiments  were  run  to  obtain^ 
modeling  data  to  predict  the  display  performance  during  the  forthcoming 
F-4  simulator  evaluation  phase  of  the  program.  The  tracking  error 
scores  for  the  new  tactile  display  are  better  than  for  the  initial 
system.  Of  the  four  subjects  employed  during  these  tests,  two 
preferred  the  electrotactor  array  because  it  provides  a  more  clearly 
perceptable  haptic  display.  (Modified  author  abstract) 
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TEST  AND  EVALUATION,  SOURCES,  OPTICAL  PROPERTIES,  PROTOTYPES,  VERTICAL 
ORIENTATION,  LUMINANCE 
ID  (25)  PE62787A,  WUDA336445 

AB  (27)  In  support  of  the  RAH-66  Comanche,  Microvision  Inc.,  Seattle, 

Washington,  has  developed  a  prototype  helmet  mounted  display  based  on 
laser  diode  sources.  This  prototype  has  been  evaluated  for  optical  and 
visual  performance.  Tests  include:  exit  pupil  size  and  shape,  eye 
relief,  f ield-of-view,  luminance,  contrast,  contrast  transfer 
function (CTF) ,  modulation  transfer  function (MTF) ,  and  interpupilary 
distance  and  vertical  adjustments. 
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DE  (23)  *VISUAL  PERCEPTION,  *STEREOSCOPIC  DISPLAY  SYSTEMS 

VIEWERS,  TELEVISION  SYSTEMS,  DEPTH,  PERFORMANCE (HUMAN) 

ID  (25)  *Depth  perception,  *Combat  displays,  Land  combat,  PE6275N,  WUDN388512 
AB  (27)  A  series  of  four  experiments  was  conducted  to  investigate  the 

independent  and  interactive  effects  of  three  video  system  parameters  on 
the  scaling  of  depth  intervals  viewed  through  stereoscopic  (stereo) 
combat  display  systems.  Experiment  One  investigated  the  effects  of 
interaxial  separation  and  lens  magnification.  Experiments  Two 
investigated  the  effects  of  camera  convergence.  Experiments  Three  and 
Four  partially  replicated  the  video  system  used  in  Experiment  One  under 
more  complex  scene  conditions.  For  all  experiments,  ocular  fatigue 
induced  by  various  combinations  of  system  parameters  was  also  measured. 
For  Experiments  One,  Two,  and  Three,  stereoscopic  imagery  produced 
depth  interval  estimates  which  were  superior  to  those  found  under 
monoscopic  viewing  conditions.  In  addition,  increasing  camera 
separation  and  thereby  increasing  retinal  disparities  beyond  natural 
stereo  values  improved  depth  interval  estimation.  Camera  convergence 
exerted  a  significant  effect  with  convergence  in  front  of  the  area  of 
interest  providing  greatest  accuracy.  Lens  mangif ication  was  not  found 
to  exert  a  significant  influence  on  depth  interval  estimation.  No 
evidence  of  ocular  fatigue  was  found  under  any  conditions  tested  in  any 
of  the  experiments.  (Author) 
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Psychology,  Bibliographies,  Retina,  Brightness,  Vision,  Man  machine 
systems.  Cathode  ray  tubes 

ID  (25)  *Eye  dominance,  *Retinal  rivalry,  Visual  coupling  systems,  *Helmet 
mounted  displays,  *Helmet  mounted  sights 
AB  (27)  An  overview  of  the  history  and  the  known  and  potential  psychological 
problems  of  helmet-mounted  displays  is  followed  by  an  extensive 
annotated  bibliography  of  relevant  material  arranged  by  topics:  eye 
dominance,  brightness  disparity,  helmet-mounted  displays /helmet-mounted 
sights,  retinal  rivalry,  and  the  AMD  visually-coupled  systems  symposium 
(of  1972).  The  bibliography  annotations,  which  vary  in  length  from  one 
sentence  to  one-half  of  a  page,  describe  the  contents  of  the  articles 
but  do  not  evaluate  them.  Most  of  the  bibliographic  entries  are  not 
listed  in  previously  published  articles  on  helmet-mounted  displays 
and/or  sights.  (Author) 
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COMPUTER  INTERFACE,  LIGHT  MODULATORS,  TELEVISION  DISPLAY  SYSTEMS,  HIGH 
DEFINITION  TELEVISION,  SCENE  GENERATION 
ID  (25)  VOLUMETRIC  DISPLAYS,  SPATIAL  LIGHT  MODULATORS,  SBIR{SMALL  BUSINESS 
INNOVATION  RESEARCH),  PE65502F,  WUAFRL3005HA8D 
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CA  (5)  DEPARTMENT  OF  THE  NAVY  WASHINGTON  DC 

TI  (6)  Computer  Program  for  a  Three-Dimensional  Volumetric  Display 
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DE  (23)  *COMPUTER  PROGRAMS,  *PATENTS,  *STEREOSCOPIC  DISPLAY  SYSTEMS 
DEFLECTORS 

ID  (25)  PAT-CL-345-6,  VOLUMETRIC  DISPLAYS,  BEAM  DEFLECTORS 

AB  (27)  A  method  for  transforming  world  coordinates  into  device  coordinates 
comprises  the  steps  of  inputting  a  set  of  world  coordinates  to  be 
displayed,  scaling  the  world  coordinates  into  view  coordinates  bounded 
by  a  display  volume,  finding  a  control  memory  location  of  a  light  beam 
deflector  corresponding  to  a  Y-axis  position  for  each  of  the  view 
coordinates,  calculating  X-axis  and  Z-axis  device  coordinates  from  the 
view  coordinates  for  deflecting  a  light  beam  to  a  selected  point  within 
the  display  volume  corresponding  to  each  of  the  view  coordinates,  and 
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loading  the  device  coordinates  into  the  control  memory  locations 
corresponding  to  the  Y-axis  position  for  each  of  the  view  coordinates 
to  cause  the  light  beam  to  be  deflected  to  each  selected  point. 
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ELECTROLUMINESCENCE,  TRANSPARENCE,  ELECTRODES 
PAT-CL-315-169 .3,  *SOLID  STATE  DISPLAYS 

A  solid  state  3-D  display  comprises  an  array  of  voxels  made  of  an 
electroluminescent  material  arranged  in  a  matrix  of  a  transparent 
material.  Transparent  electrodes  are  formed  in  the  matrix  to  form 
electrical  connections  to  each  voxel.  The  transparent  electrodes  are 
connected  to  voltage  sources  outside  the  display  volume  for  controlling 
the  optical  output  of  each  voxel  to  produce  a  three-dimensional  image 
inside  the  display  volume. 
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NO  (21)  Supersedes  AD-A355  592.  Original  contains  color  plates:  All  DTIC 
reproductions  will  be  in  black  and  white. 

DE  (23)  ^COMPUTER  GRAPHICS,  *VIRTUAL  REALITY,  *STEREOSCOPIC  DISPLAY  SYSTEMS 
COMPUTERIZED  SIMULATION,  LASER  BEAMS,  THREE  DIMENSIONAL,  VISUAL 
PERCEPTION 

ID  (25)  * VOLUMETRIC  DISPLAYS 

AB  (27)  The  Space  and  Naval  Warfare  (SPAWAR)  Systems  Center,  San  Diego  (SSC  San 
Diego)  Simulation  and  Human  Technology  Division  has  developed  and 
improved  its  second  generation  3-D  Volumetric  Display  System  for 
displaying  data,  information,  and  scenes  in  a  three  dimensional  volume 
of  image  space.  The  system  has  good  potential  for  many  military  and 
commercial  applications.  Based  on  a  computer  controlled  laser  optics 
system  that  projects  three  laser  beams  simultaneously  onto  a  36-inch 
diameter/18-inch  high  double  helix  spinning  at  600  revolutions  per 
minute,  this  system  presents  3-D  images  in  an  addressable  10  cubic  feet 
of  cylindrical  volume.  This  report  discusses  the  four  basic  disciplines 
used  in  development  of  the  Improved  Second  Generation  3-D  Volumetric 
Display  System  and  provides  examples  of  practical  applications  of  the 
technology. 
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Advanced  Research  Projects  Agency,  3701  N.  Fairfax  Dr.,  Arlington,  VA 
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HIGH  RESOLUTION,  THREE  DIMENSIONAL,  MULTIPURPOSE,  LIGHT  MODULATORS 
ID  (25)  VOLUMETRIC  DISPLAYS,  SBIR{SMALL  BUSINESS  INNOVATION  RESEARCH),  *THREE 
DIMENSIONAL  DISPLAYS,  MICROLASERS,  VOXELS,  SPATIAL  LIGHT  MODULATORS 
AB  (27)  Report  developed  under  SBIR  contract.  A  first  step  has  been  completed 

toward  implementing  a  three  dimensional  display  capability  for  complex, 
multi -dimensional  information.  By  combining  microlaser  based  full  color 
display  technology  developed  by  Laser  Power  Corporation  (LPC)  with  a 
three  dimensional  display  monitor  developed  by  Specialty  Devices 
Incorporated  (SDI) ,  LPC  assembled  and  demonstrated  a  16  x  16  x  16  voxel 
test  bed  that  displayed  fully  recognizable  static  and  dynamic  images  in 
monochrome,  white  and  full  color.  Additional  work  in  this  Phase  1  SBIR 
effort  included  determining  three  dimensional  display  requirements  for 
a  variety  of  applications.  These  included  military  applications  such  as 
the  Army's  virtual  sand  table,  to  be  used  in  the  Command  Post  of  the 
Future,  and  the  Navy's  horizontal  large  screen  display,  medical 
diagnostics  applications  such  as  three  dimensional  viewing  of  CAT  and 
PET  scans,  air  traffic  control  displays  and  entertainment  applications 
such  as  volumetric  video  and  computer  games.  Based  on  the  Phase  1  test 
bed  success  and  the  results  of  the  requirements  review,  LPC  is  prepared 
to  continue  with  a  Phase  2  effort  to  develop  a  two  million  voxel 
display  demonstration  device  based  on  an  advanced  microlaser  based 
display  system  and  an  enhanced  three  dimensional  monitor. 
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IMAGE  PROCESSING,  DATA  MANAGEMENT,  MINE  COUNTERMEASURES,  MINE 
DETECTION,  COMPUTER  GRAPHICS,  COMPUTER  VISION,  DATA  DISPLAYS, 
INTERACTIVE  GRAPHICS,  HELMET  MOUNTED  DISPLAYS 
AB  (27)  This  research  accomplished  as  a  result  of  this  effort  focused  on  the 
alliance  of  elements  of  virtual  reality  technology  and  elements  of 
scientific  visualization  to  address  issues  of  mine  detection  and 
related  spatial  and  volumetric  visualization  problems.  By  virtual 
environments,  we  meant  an  immersive  visual  and  audio  technology  such 
that  experimenter  has  little  or  no  awareness  of  the  real  environment. 
For  our  purposes  of  data  visualization,  this  was  intended  as  a  focusing 
devise  so  that  the  experimenter  has  a  heightened  sense  of  awareness  of 
the  problem  at  hand  thus,  can  concentrate  in  a  natural  way  his  or  her 
full  mental  resources.  Much  of  currently  fashionable  work  on  scientific 
visualization  bad  been  focused  on  rendering  on  flow  fields  arising  from 
combustion  or  meteorological  applications,  molecular,  atomic  or 
subatomic  particle  dynamics,  and  other  settings  modeled  with  partial 
differential  equation  models.  Our  focus  had  been,  in  contrast,  or  data 
representation,  exploratory  data  analysis  and  model  building  using  high 
performance  computer  graphics,  much  of  which  has  recently  emerged  under 
the  name  data  mining. 
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SBIR (SMALL  BUSINESS  INNOVATATION  RESEARCH) 

This  document  is  the  final  report  for  this  SBIR  phase  2  development 
effort.  The  goal  of  this  project  was  to  develop  a  prototype  three 
dimensional  display  based  upon  the  Multiplanar  Volumetric  Display  (MVD) 
technology  of  Dimensional  Media  Associates,  Inc.  The  MVD  concept  will 
enable  the  production  of  high  resolution,  full  color,  three  dimensional 
images  which  actually  float  in  the  air  out  in  front  of  the  display.  The 
images  have  a  wide  field  of  view  and  are  truly  3D,  that  is,  the  3D 
image  is  not  created  by  manipulating  the  visual  perceptions  of  the 
viewer.  Furthermore,  the  fact  that  the  image  floats  in  free  space,  and 
is  not  confined  within  the  display,  permits  a  virtual  interaction  with 
the  image.  The  3D  image  may  actually  be  touched  and  manipulated  through 
the  use  of  a  force  feedback  interface  enabling  a  truly  unique  interface 
modality.  A  schematic  diagram  of  the  prototype  MVD  is  shown. 
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AB  (27)  A  three  dimensional  volumetric  display  system  utilizing  a  rotating 

helical  surface  is  described.  The  rotating  helix  system  permits  images 
be  displayed  in  a  three  dimensional  format  that  can  be  observed  without 
the  use  of  special  glasses.  Its  rotating  helical  screen  sweeps  out  a 
cylindrical  envelope,  providing  a  volumetric  display  medium  through 
which  scanned  laser  pulses  are  projected.  The  light  scatters  from  the 
surface  of  the  helix  so  that  each  voxel  appears  to  emanate  from 
specific  points  in  space.  Each  point  has  x-y  coordinates  determined  by 
the  laser  scanner  and  a  z  coordinate  determined  by  the  intersection  of 
the  laser  beam  and  the  helix  surface.  Display  images  are  created  by 
synchronizing  the  interaction  of  the  laser  pulses  and  the  moving  screen 
to  address  a  full  three  dimensional  volume  that  gives  the  viewer  true 
depth  cues  (binocular  parallax,  accommodation,  convergence)  without  the 
need  for  any  special  viewing  aids.  We  describe  recent  work  on  the 
development  of  mechanical,  optical,  electronic,  and  software 
engineering  for  a  display  system  based  on  a  36-inch  diameter  helix 
using  high  speed,  multichannel,  random  access  laser  scanners.  Color 
images  are  created  using  red,  green,  and  blue  laser  sources.  The  system 
is  capable  of  displaying  800,000  voxels  per  second,  per  color.  A 
portable,  12-inch  diameter,  translucent  helix  system  is  also  present. 
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NRaD,  the  RDT&E  Division  of  the  Naval  Command,  Control  and  Ocean 
Surveillance  Center  (NCCOSC) ,  has  developed  and  improved  its 
second-generation  device  for  displaying  data,  information,  and  scenes 
in  a  three-dimensional  volume  of  image  space.  The  device  incorporates  a 
36-inch  diameter  double  helix  that  spins  at  approximately  10 
revolutions  per  second,  providing  a  means  to  address  a  cylindrical 
volume.  Under  computer  control,  a  laser  beam  is  directed  to  illuminate 
certain  discrete  volume  points  (voxels)  on  the  helix  needed  to  create  a 
scene.  The  laser  light  scatters  from  the  surface  of  the  helix,  so,  to 
the  observer,  each  voxel  appears  to  emanate  from  specific  points  in 
space.  Each  point  has  x-y  coordinates  determined  by  the  position  of  the 
laser  beam  and  a  z  coordinate  determined  by  the  height  of  the  point  on 
the  helical  surface.  Any  point  within  the  cylindrical  image  volume  can 
be  computer- addressed  to  appropriately  synchronize  the  laser  beam,  the 
Acousto-Optic  (AO)  Scanner,  and  the  phase  of  the  helix.  Using  a  novel 
Acousto-Optic  (AO)  Random-Access  Scanner,  up  to  40,000  laser-generated 
voxels  refreshed  at  20  Hz  per  color  are  projected  onto  the  reflective 
surface  of  the  rotating  helix.  (This  is  about  10  times  more  than  the 
current  state  of  the  art.)  The  higher  resolution  allows  improved  color 
images,  updated  in  real-time,  for  group  viewing  with  the  naked  eye. 
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AB  (27)  In  the  past  several  years,  the  Display  Systems  Branch,  Naval  Ocean 

Systems  Center  (NOSC) ,  has  been  involved  in  the  development  of  laser 
based  display  systems  with  the  goal  of  upgrading  the  image  quality  of 
shipboard  displays.  In  the  paper  we  report  work  on:  (1)  developing 
laser  generated  3D  volumetric  images  on  a  rotating  double  helix,  (where 
the  3D  displays  are  computer  controlled  for  group  viewing  with  the 
naked  eye),  and  (2)  system  feasibility  results  along  with  the  first  and 
second  generation  component  parameters . 
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AB  (27)  This  thesis  describes  an  interactive  interface  to  a  true  three 

dimensional,  real -dm  dynamic  graphic  display,  the  TI  Omniview.  The 
system  generates  true  3-D  images  of  volumetric  data  and  objects.  The  TI 
Omniview  is  a  cylindrical  volumetric  laser  display  that  uses  a  rotating 
double-helix  translucent  disk  to  fill  the  display  cylinder.  Voxels  are 
illuminated  on  the  2-D  surface.  The  rotational  speed  of  the  disk  allows 
the  viewer  to  fuse  the  2-D  images  into  a  true  3-D  image.  The  interface 
provides  the  user  with  a  quick  and  flexible  means  of  manipulating  the 
image  generated,  the  sub-volume  displayed,  and  the  resulting  3-D  image. 
The  interface  provides  the  user  with  the  flexibility  and  convenience 
that  a  window,  icon,  mouse,  and  pointer  graphical  user  interface 
provides  to  users  of  2-D  displays.  Limitations  of  the  device,  however, 
do  not  allow  the  use  of  icons  and  pointers  in  the  Omniview  display. 
Instead  a  combination  of  voice  commands,  a  joystick,  and  a  2-D  menu 
system  running  on  a  host  computer  is  used  to  provide  the  interface. 
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This  interface  allows  the  user  to  select  objects  and  scenes,  but  does 
not  allow  manipulation,  such  as  rotation  or  placement,  of  individual 
objects....  Three  dimensional  display  systems.  Interactive  graphics, 
Man  computer  interface,  3-D  Manipulation. 
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ID  (25)  PE61153N,  WUNR196166 

AB  (27)  We  perceive  and  comprehend  a  visual  world  of  three  spatial  dimensions. 

However,  current  computer-generated  graphical  displays  generally  fail 
to  utilize  the  full  potential  of  visual  perception  in  that  they  create 
and  present  only  flat  2-D  images.  Methods  are  described  for  extending 
computer-generated  displays  to  provide  three-dimensional  images,  and 
focus  on  the  recent  development  of  a  practical,  true  volumetric 
display.  The  results  are  summarized  for  several  perceptual  experiments, 
conducted  with  this  volumetric  display,  designed  to  further  our 
understanding  of  the  perception  of  orientation  and  direction  in  a 
displayed  three-dimensional  volume.  The  accuracy  of  perceived 
orientation  and  direction  is  an  important  issue  in  considering  possible 
applications  for  3-D  displays.  Keywords:  Reprints;  3-Display;  Depth 
perception;  Spatial  perception;  Orientation;  Image  processing. 
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AB  (27)  This  research  program  explored  human  perceptual  performance  as 

influenced  by  display-control  compatibility  with  a  volumetric  3-D 
display  technique.  The  work  was  organized  into  three  phases.  In  the 
first,  we  studied  how  the  speed  and  accuracy  of  the  operator's 
decisions  about  the  orientation  of  a  displayed  object  (a  cube)  was 
affected  as  this  orientation  was  varied  relative  to  that  of  a  fixed 
control  (a  cubical  response  box) .  In  the  second,  we  studied  how 
accurately  the  observer  can  perceive  and  project  a  trajectory  presented 
within  the  display,  as  a  function  of  the  trajectory's  orientation.  In 
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the  third  phase,  we  used  a  real-time  control  task  to  measure  directly 
the  relative  utility  of  the  three  dimensions  of  the  display.  (Author) 
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AB  (27)  This  report  describes  the  second  set  of  four  experiments  in  a  series  of 
studies  on  display-control  compatibility  issues  in  a  true  volumetric 
display  called  SpaceGraph.  As  in  the  initial  set  of  experiments,  we 
measured  the  speed  and  accuracy  of  simple  control  decisions  when  the 
displayed  object  was  presented  in  orientations  rotated  away  from 
congruence  with  the  control  orientation.  Reaction  times  were  measured 
for  identifying  the  marked  face  of  a  static  cube,  presented  with 
SpaceGraph,  as  a  function  of  how  much  the  cube  image  was  rotated  away 
from  congruence  with  fixed  physical  cube  on  which  the  observer 
responded,  using  orientation  cues  with  various  symmetries. 
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AB  (27)  The  recent  development  of  true  volumetric  displays,  such  as  SpaceGraph, 
has  raised  questions  about  display-control  relationships  that  cannot  be 
answered  from  earlier  work  with  2-D  displays.  We  measured  the  speed  and 
accuracy  of  simple  control  decisions  when  the  displayed  object  was 
presented  in  orientations  rotated  away  from  congruence  with  the  control 
orientation.  Reaction  times  were  measured  for  identifying  the  marked 
face  of  a  static  cube,  presented  with  SpaceGraph,  as  a  function  of  how 
much  the  cube  image  was  rotated  away  from  congruence  with  fixed 
physical  cube  on  which  the  observer  responded,  and  which  dimension  of 
the  display  corresponding  to  the  rotation  axis .  The  following  results 
were  obtained:  The  fastest  and  most  accurate  identifications  occurred 
when  there  was  a  simple  direct  spatial  mapping  between  the  display  and 


the  control  for  all  orientations  presented.  Decision  times  made  with 
this  strategy  were  relatively  unaffected  by  orientation;  Marked 
display-control  incompatibility  was  found  under  some  specific 
conditions;  and  The  shape  of  the  decision  time  functions  suggest  that 
decision  strategies  involved  both  propositioned  coding  and  mental 
rotation.  (Author) 
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AB  (27)  Simulation  using  virtual  reality  (VR)  is  becoming  an  effective  tool  for 
the  Army  in  training  soldiers  to  do  their  required  tasks.  In  VR,  the 
human  operator  can  interact  with  a  wide  variety  of  computer  generated 
worlds  developed  from  real  or  imaginary  scenarios  or  both.  The  training 
that  a  soldier  receives  by  simulation  is  usually  cost  effective  to  the 
Army  and  in  a  number  of  cases  is  safer  for  the  individual  than  training 
in  the  real  environment.  Three  dimensional  (3-D)  sound  in  the  virtual 
environment  (VE)  provides  a  more  realistic  simulation  of  acoustic 
environments  compared  to  diotic  (mono)  or  dichotic  (stereo)  sound 
presentation.  The  major  benefit  of  using  3-D  sound  is  that  an 
individual  can  determine  the  sound  source  direction.  When  sounds  that 
are  perceived  to  have  direction  and  sights  that  represent  virtual 
objects  that  produce  the  sounds  are  provided  through  a  head  mounted 
display,  a  person  can  monitor  and  identify  sources  of  information  from 
all  possible  locations.  The  purpose  of  this  study  was  to  determine  if 
3-D  sound  generated  by  a  3-D  sound  system  could  enhance  the  realism  or 
fidelity  of  the  VE.  The  main  objective  of  the  study  was  to  determine  if 
an  individual  could  distinguish  the  direction  of  a  sound  source  within 
a  reasonable  degree  of  accuracy.  Three  dimensional  sound  is  produced  by 
using  a  mathematical  representation  of  the  filtering  characteristics  of 
the  pinnae  provided  through  head  related  transfer  functions  (HRTFs) . 

The  HRTFs  can  be  developed  by  recording  a  generated  broadband  sound 
using  a  probe  microphone  in  the  ear  canal  and  subsequently  dividing  the 
Fourier  transform  of  the  recorded  sound  by  that  of  the  generated  sound. 
When  digital  filtering  techniques  are  used,  HRTFs  can  be  applied  to 
sounds  through  headphones.  When  an  arbitrary  sound  is  filtered  with 
HRTF  based  filters,  the  sound  should  appear  to  come  from  specified 
virtual  locations  outside  the  earphones. 
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Current  human  machine  interfaces  in  Navy  systems  which  incorporate 
headphone  listening  fail  to  take  full  advantage  of  human  binaural 
sensory  processing  capabilities.  These  interfaces  can  be  improved  by 
providing  the  capability  to  present  multiple  spatialized  audio  channels 
over  headphones  using  technology  which  is  available  today.  Before  these 
changes  are  considered,  quantitative  testing  must  take  place  which ^ 
addresses  the  task  to  be  performed,  and  the  impact  the  spatialization 
will  have  on  the  task.  This  poster  will  describe  a  testing  system  for 
quantifying  the  effects  of  3-D  audio  spatialization  on  a  detection  and 
classification  problem  similar  in  important  ways  to  a  sonar  operator's 
task . 
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AB  (27)  An  audio  localization  cue  synthesizer,  the  DIRectional  Audio  Display 
(DIRAD)  was  used  to  simulate  auditory  distance,  room  reflections,  and 
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to  provide  spatial  audio  for  computer  graphics  images.  The  DIRAD 
processes  input  audio  signals  to  generate  spatially  located  sounds  for 
headphone  listening.  The  DIRAD  can  position  audio  sources  around  the 
head  and  these  sounds  are  stable  with  respect  to  the  listener's  head 
position.  An  interactive,  real-time  simulation  of  auditory  distance  and 
room  reflections  was  accomplished  using  the  DIRAD  in  combination  with  a 
Silicon  Graphics  audio  processor  board  installed  in  a  Personal  Iris 
4D/35.  Several  demonstrations  of  auditory  distance  and  the  effects  of 
early  reflections  are  detailed,  including  a  simulation  of  a  direct 
sound  source  and  three  reflections  that  employed  two  DIRAD  systems. 
Stored  sound  files  were  used  to  accompany  three  dimensional  graphics 
images  that  were  displayed  on  both  a  Silicon  Graphics  CRT  and  a  three 
dimensional  optical  display  device.  The  use  of  the  4D/35  audio 
processor  board  proved  to  be  an  effective  means  of  preprocessing  audio 
for  the  DIRAD  for  these  simulations.  The  combination  of  AFIT's  Silicon 
Graphics  workstations  and  the  DIRAD  proved  to  be  a  practical  solution 
to  the  problem  of  combining  virtual  visual  and  audio  cues....  Auditory 
localization.  Auditory  perception.  Virtual  reality,  3-D  Audio,  Acoustic 
reflection,  Sound  equipment. 
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Subcontractor  (Southwest  Research  Institute)  provides  a  description  of 
the  hardware  assembled  and  software  created  to  develop  the  3-D  AOI.  A 
Macintosh  llx  computer  is  the  heart  of  the  system,  acting  as  a  general 
controller  and  processor  of  data  flowing  from  the  Flight  Information 
Package  to  the  Audio  Localization  Cue  Synthesizer,  audio  mixer, 
headphones,  and  data  recording  equipment.  A  National  Instruments 
NB-DSP2300  digital  signal  processing  board  and  NB-A2100  audio  1/0  board 
generate  the  audio  signals,  and  National  instruments  LabView  software 
is  used  to  control  the  auditoiry  display.  The  majority  of  this  report  is 
a  description  of  the  18  LabView  software  modules  created  to  control  the 
3-D  AOI  display. . . .  Acoustic  orientation,  Flight  instrumentation. 
Auditory  localization.  Aural  displays. 
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Gestural  interfaces  have  the  potential  of  enhancing  control  operations 
in  numerous  applications.  For  Air  Force  systems,  machine-recognition  of 
whole-hand  gestures  may  be  useful  as  an  alternative  controller, 
especially  when  conventional  controls  are  less  accessible.  The 
objective  of  this  effort  was  to  explore  the  utility  of  a  neural 
network-based  approach  to  the  recognition  of  whole-hand  gestures .  Using 
a  fiber-optic  instrumented  glove,  gesture  data  were  collected  for  a  set 
of  static  gestures  drawn  from  the  manual  alphabet  used  by  the  deaf.  Two 
types  of  neural  networks  (multilayer  perceptron  and  Kohonen 
self-organizing  feature  map)  were  explored.  Both  showed  promise,  but 
the  perceptron  model  was  quicker  to  implement  and  classification  is 
inherent  in  the  model.  The  high  gesture  recognition  rates  and  quick 
network  retraining  times  found  in  the  present  study  suggest  that  a 
neural  network  approach  to  gesture  recognition  be  further  evaluated. 
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In  January  1996,  the  Working  Group  25  of  the  former  AGARD  Aerospace 
Medical  Panel  began  to  evaluate  the  potential  of  alternative  (new  and 
emerging)  control  technologies  for  future  aerospace  systems.  The 
present  report  summarizes  the  findings  of  this  group.  Through  different 
chapters,  the  various  human  factors  issues  related  to  the  introduction 
of  alternative  control  technologies  into  military  cockpits  are 
reviewed,  in  conjunction  with  more  technical  considerations  of  the 
state  of  the  art  of  the  enabling  technologies.  Cockpit  integration 
issues  are  emphasized  in  regard  to  both  human  factors  and  engineering 
constraints.  Several  specific  applications  of  these  new  technologies  in 
the  aerospace  environment  are  considered.  Challenges  for  further 
developments  are  identified  and  recommendations  issued.  Globally,  based 
upon  operational  considerations  and  currently  recognized  limitations  of 
the  HOTAS  concept,  the  conclusion  is  that  Alternative  Control 
Technology  should  now  be  progressively  introduced  into  the  cockpit,  as 
a  function  of  degree  of  maturity  of  the  various  techniques. 
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AB  (27)  New  concepts  in  HUD  symbology,  based  on  an  understanding  of  the 

physiological  mechanisms  and  ecological  origins  of  the  human  visual 
system  are  described  which  may  enable  future  HUD  displays  to  serve  as 
primary  flight  directors  in  addition  to  their  current  roles.  The  four 
key  elements  of  this  new  symbology  are:  a)  prioritization  of  space 
according  to  the  three-dimensional  structure  of  visual  attention,  b)  an 
attitude  display  in  the  form  of  a  global  percept;  c)  effective 
preattentive  attitude  cueing  based  on  an  ecologically  valid  simulation 
of  the  visual  terrain  during  flight  ;  and  d)  visual  reference  framing 
which  depicts  the  roll  of  the  aircraft  relative  to  a  stable  horizon. 
Prototypes  which  illustrate  the  'physiological  HUD'  concept  are 
presented.  The  specific  advantage  of  the  proposed  symbology  may  be  to 
allow  the  pilot  to  maintain  effective  attitude  control  while  directing 
his  attention  towards  the  out -the -window  environment.  Keywords:  Head  up 
displays,  visual  perception.  Visual  displays.  Pilots,  (aw) 
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TEST  AND  EVALUATION,  CONTROL,  ANGLES,  MARINE  CORPS,  PERFORMANCE ( HUMAN )  , 
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FLIGHT,  VISUAL  PERCEPTION,  EXPOSURE ( PHYSIOLOGY) ,  RANGE (EXTREMES ) , 
NUMBERS,  SEMIAUTOMATIC,  SCORING,  BIOMEDICINE,  VESTIBULAR  APPARATUS 
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AB  (27)  A  performance-based  test  of  gaze  capability  has  been  developed  using 
low-cost  light-emit ting-diode  (LED)  displays  operated  under  the 
semi -automated  control  of  a  desk  top  micro-computer.  The  test  is  based 
on  the  ability  of  an  individual  to  rapidly  shift  his  gaze  over  a 
relatively  large  angle  and  precisely  identify  digits  presented  in  a 
numeric  array  for  brief,  time-varied  exposure  times.  The  new  test, 
involving  four  widely-spaced  displays,  allows  the  derivation  of 
performance  scores  for  gaze  shifts  involving  head  movements  made  in  the 
left,  right,  up,  and  down  directions.  The  results  of  three  experiments 
involving  Navy  and  Marine  Corps  flight  candidates  as  subjects,  support 
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the  original  report  findings  relative  to  the  heavy  influence  of 
exposure  time  on  performance;  and  most  importantly,  the  wide  range  of 
performance  capabilities  reflected  within  the  study  population.  This 
latter  point  has  the  potential  for  operational  significance  in  that  the 
test  should  distinguish  pilots  with  exceptional  gaze  capabilities  from 
those  with  relatively  poor  gaze  performance.  Keywords:  Vestibular 
apparatus.  Head/eye  coordination.  Biomedical  tests,  (aw) 
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A  Visually- Coupled  Airborne  Systems  Simulator  (VCASS)  -  An  Approach  to 
Visual  Simulation. 
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Presented  at  the  IMAGE  Conference,  Phoenix,  Ariz.,  17-18  May  77. 
*Display  systems,  *Flight  simulators 

Man  machine  systems.  Flight  training.  Stereoscopic  display  systems. 
Pilots,  Space  perception.  Head  up  displays.  Helmet  mounted  displays. 
Visual  perception.  Coupling (Interaction) ,  Flight  crews 
WUAMRL71842001,  PE62202F 

This  paper  describes  a  new  approach  to  solving  the  visual  presentation 
problems  of  aircraft  simulators  by  using  visually  coupled  systems 
(VCS) .  For  many  years  it  has  been  the  mission  of  this  laboratory  to 
optimize  the  visual  interface  of  crew  members  to  advanced  weapon 
systems.  This  mission  has  been  primarily  pursued  in  two  areas:  (1)  the 
establishment  of  control/display  engineering  criteria;  and  (2)  the 
prototyping  of  advanced  concepts  for  control  and  display  interface.  An 
important  part  of  fulfilling  this  mission  has  been  the  development  of 
VCS  components  which  includes  head  position  sensing  systems  or  helmet 
mounted  sights  (HMS) ,  eye  position  sensing  systems  (EPS)  and  helmet 
mounted  displays  (HMD) .  The  author  believes  that  the  unique 
capabilities  of  a  visually-coupled  system  (VCS  -combination  of  a 
helmet-mounted  sight  and  helmet-mounted  display)  can  meet  the 
simulation  requirements  as  well  as  improve  upon  existing  ground  based 
simulation  techniques. 
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INTERFACE 

AIRCRAFT  MAINTENANCE,  MAINTENANCE  PERSONNEL,  MAINTENANCE  MANAGEMENT, 
MANPORTABLE  EQUIPMENT,  MICROPHONES,  NATURAL  LANGUAGE,  HELMET  MOUNTED 
DISPLAYS,  MAINTENANCE  EQUIPMENT 
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AB  (27)  Final  Report  for  the  Integrated,  Hands-Free  Control  Suites  for 
Maintenance  Wearable  Computers -VHIC .  SYTRONICS  and  UDRI  applied 
significant  experience  and  familiarity  with  the  warfighter's  needs  in 
aircraft  maintenance  to  the  problem  of  having  hands-free  control  of 
wearable  computers  so  that  they  may  access  technical  data  easily  and 
effectively.  This  report  outlines  the  development  of  an  operation 
prototype  that  is  an  innovative  combination  of  head- tracking  and  speech 
recognition  for  effective  and  intuitive  interfacing  that  was  used  by 
subject  matter  experts  to  evaluate  the  utility  of  the  system.  A  simple 
two-controller  approach  uses  voice  for  text-and-click  entry  and  head 
movement,  as  well  as  speech,  for  pointing.  A  dampered  throat  microphone 
filters  noise  and  a  simple  inertial  tracker  provides  cursor  movement. 
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Distribution  authorized  to  U.S.  Gov't,  agencies  and  their  contractors; 
Critical  Technology;  Sep  2000.  Other  requests  shall  be  referred  to  Air 
Force  Research  Lab/IFEC,  Rome,  NY  13441.,  This  document  contains 
export-controlled  technical  data. 

* SPEECH  RECOGNITION 

ALGORITHMS,  SOFTWARE  ENGINEERING,  TEST  BEDS,  DISPLAY  SYSTEMS, 
CORRELATION,  INTEGRATION,  SPEECH  REPRESENTATION,  GRAPHICAL  USER 
INTERFACE 

EXPORT  CONTROL,  AUDIO  CORRELATION,  SPEAKER  IDENTIFICATION,  STI (SPEECH 
TECHNOLOGIES  INTEGRATION) PROGRAM,  PE35885G,  WUAFRL1049 02 08 
This  program  developed  a  speech  technology  integration  testbed.  An 
audio  correlation  algorithm  was  delivered  to  AFRL  an  demonstrated  with 
speaker  and  language  identification  algorithms.  Advanced  displays, 
tailored  to  the  operational  user  were  developed  to  include  prototype 
communications  network  and  echelon  displays.  Finally,  vital  tables  used 
in  the  correlation  algorithm  were  modified  to  better  reflect  inputs. 
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In  support  of  the  RAH-66  Comanche,  Microvision  Inc.,  Seattle, 
Washington,  has  developed  a  prototype  helmet  mounted  display  based  on 
laser  diode  sources .  This  prototype  has  been  evaluated  for  optical  and 
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visual  performance.  Tests  include:  exit  pupil  size  and  shape,  eye 
relief,  f ield-of-view,  luminance,  contrast,  contrast  transfer 
function (CTF) ,  modulation  transfer  function (MTF) ,  and  interpupilary 
distance  and  vertical  adjustments . 
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PROTOTYPES,  COMPUTER  GRAPHICS,  RADIO  LINKS,  HAND  HELD,  RADIOTELEPHONES 
ID  (25)  EXPORT  CONTROL 

AB  (27)  This  report  describes  work  completed  on  the  Hand  Held  and  Body  Worn 
Graphical  Display  System  program.  Two  novel  applications  of  color 
miniature  active  matrix  electroluminescent  (AMEL)  displays  were 
developed,  prototyped  and  delivered  to  the  Army.  These  novel  display 
system  prototypes  were  used  to  explore  new  ways  for  the  soldier  to 
access  graphical  and  image  data  in  the  field.  The  first  prototype, 
called  the  Body  Worn  Display,  has  a  wireless  RF  link  of  color  640  x  480 
VGA  data.  The  RF  allows  the  display  to  be  updated  at  30  frames  per 


second,  a  data  rate  high  enough  for  video  to  be  viewed.  This  first  of 
its  kind  wireless  display  design  provides  the  soldier  with  all  the 
performance  of  a  hard  wired  display,  but  in  a  highly  flexible  package. 
Because  it  is  wireless,  the  display  can  be  easily  worn,  handled, 
pocketed  and  shared.  The  second  prototype,  a  hand  held  computer  with  a 
see  through  display  represented  an  alternative  to  simply  using  a  large, 
direct  view  display  with  a  hand  held  computer.  A  scope  with  a  color 
display  in  the  optical  path  was  combined  with  a  hand  held  computer.  The 
displayed  image  is  superimposed  on  the  real  world  as  viewed  through  the 
scope.  This  capability  to  view  a  computer  screen  overlaid  onto  the  real 
world  allows  for  some  innovative  applications  such  as  image 
capture /comparison  and  terrain  map  overlaying. 
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DE  (23)  *LIQUID  CRYSTAL  DISPLAY  SYSTEMS,  *HELMET  MOUNTED  DISPLAYS,  *SILICON  ON 
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LINE  OF  SIGHT,  OFF  THE  SHELF  EQUIPMENT,  OPTICAL  COMMUNICATIONS,  HIGH 
RESOLUTION,  HUMAN  FACTORS  ENGINEERING,  COLOR  DISPLAYS,  VISUAL 
PERCEPTION,  MAN  COMPUTER  INTERFACE,  SHUTTERS (OPTICS) ,  PIXELS,  LOW 
RESOLUTION,  STEREOSCOPIC  DISPLAY  SYSTEMS 
AB  (27)  The  main  goals  of  our  program  can  be  summarized  as  follows:  (1)  To 

design  and  build  a  helmet  mounted  display  with  commercially  available 
components  in  order  to  demonstrate  the  proposed  dual  insertion  display 
concept  which  will  provide  a  very  large  field  of  view  (FOV  image) .  (2) 

To  design  and  layout  silicon  on  sapphire  circuits  which  will  be  used  in 
the  Phase  2  work.  (3)  To  examine  the  issues  associated  with  the 
wireless  communication  of  images.  The  goal  of  the  Phase  2  program  is  to 
replace  the  commercially  available  low  resolution  displays  of  the  Phase 
1  HMD  prototype  with  ultrathin  silicon  on  sapphire  based  active  matrix 
addressed  liquid  crystal  displays  (AMLCDs) .  As  explained  in  the 
following  sections  of  the  proposal,  the  use  of  ultrathin  silicon  on 
sapphire  (UTSOS)  technology  provides  some  fundamental  advantages  which 
gives  us  the  technological  edge  when  competing  with  other  display 
companies.  The  final  HMD  will  receive  image  data  via  wireless 
transmission  channels.  Color  will  be  generated  using  Textronix  color 
shutters . 
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ID  (25)  TACTICAL  DECISION  AID 

AB  (27)  In  our  Phase  I  SBIR  effort,  we  sought  to  define  the  requirements  for  a 
3-D  toolkit  for  tactical  decision  aids,  evaluate  current  and  emerging 
3-D  tools,  establish  a  toolkit,  and  develop  and  evaluate  a  prototype 
display  to  demonstrate  the  toolkit's  utility.  Our  study  of  30  3-D 
toolkits  revealed  that  tools  capable  of  producing  satisfactory  TACAIDs 
on  TAC-N  platforms  entail  high  licensing  costs.  We  showed  that  a 
toolkit  developed  specifically  for  ASTO-E  would  entail  substantially 
lower  licensing  costs.  We  developed  a  core  3-D  toolkit  and  used  it  to 
build  a  prototype  active  sonar  search  effectiveness  display.  Its 
ability  to  interactively  manipulate  challenging  data  sets  on  a  typical 
TAC-3  platform  without  special  3-D  graphics  acceleration  hardware 
demonstrated  the  feasibility  of  using  it  to  build  most  3-D  SPP 
displays.  A  full-scale  3-D  toolkit  can  be  developed  to  provide  the 
TACAID  developer  with  rapid  prototyping  capabilities,  independence  from 
low-level  language  interaction,  portability,  and  run-time  license  free 
distribution  of  displays. 


AN  (1)  AD-A230  649/XA6 

CA  (5)  NAVAL  OCEAN  SYSTEMS  CENTER  SAN  DIEGO  CA 

TI  (6)  A  Head  Coupled  Sensor  Platform  for  Teleoperated  Ground  Vehicles 

AU  (10)  McDonnell,  John  R. 

Solorzano,  Manuel  R. 

Martin,  Stephen  W. 

Umeda ,  Alan  Y . 

RD  (11)  Dec  1990 

PG  (12)  10  Pages 

RN  (18)  XN-USMC 

RC  (20)  Unclassified  report 

DE  (23)  COUPLING (INTERACTION) ,  DETECTORS,  DISPLAY  SYSTEMS,  DYNAMICS, 

ELECTROMECHANICAL  DEVICES,  FORMULATIONS,  GROUND  VEHICLES,  HEAD  UP 
DISPLAYS,  PLATFORMS,  PROTOTYPES,  REMOTE  SYSTEMS,  SIMULATION, 
TELEOPERATORS,  TILT,  TRAJECTORIES,  UNMANNED,  VISION 
ID  (25)  Head  mounted  displays.  Telerobotics,  TOV (Teleoperated  Vehicles) ,  Remote 
vision.  Ground  vehicles.  Teleoperators,  Remote  areas/control. 
Audiovisual  aids.  Head  anatomy  motion.  Remote  detectors.  Robotics, 
Television  systems,  PE65151M,  WUDN308274 
AB  (27)  This  paper  describes  a  remote  vision  system  applicable  to  the 

teleoperation  of  unmanned  ground  vehicles.  The  features  of  the  remote 
vision  system  are  presented  along  with  a  description  of  its  components : 
a  sensor  suite,  a  head  slaved  platform,  and  a  head  mounted  display.  An 
emphasis  is  placed  on  the  remote  platform  dynamics.  Performance  goals 
are  discussed  and  nominal  head  trajectories  generated  for  use  in  a 
simulation  study  which  was  conducted  to  determine  if  these  goals  are 
achievable.  Simulation  and  experimental  results  demonstrate  that  the 
electromechanical  pan  and  tilt  prototype  approaches  the  desired 
performance  goals.  An  analytical  formulation  of  the  pan  and  tilt 
dynamics  is  also  given.  (EDO 
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AB  (27)  This  report  details  the  continuing  development  of  a  fiber-optic- 
coupled,  head- and  eye -slaved,  helmet -mounted  display.  An  advanced 
prototype  model  has  been  developed  and  installed  in  conjunction  with  a 
multiprocessor-based  F-16  flight  simulator.  The  new  optical  design 
results  in  a  wider  instantaneous  field  of  view  and  better  color 
rendition.  Improvements  in  custom  helmets,  use  of  rate  sensors  in 
head-tracking,  and  better  video  blending  techniques  are  described. 
Techniques  for  substantially  reducing  fiber-optic  bundle  pattern  noise 
have  been  explored.  Studies  have  been  conducted  to  validate  and 
optimize  display  performance.  The  development  program  for  a 
helmet-mounted  eye- tracker  is  described.  Requirements  for  a  fully 
eye-slaved  system  are  addressed.  Keywords:  Eye  tracking.  Fiber  optics. 
Helmet-mounted  display,  Infinity  display,  Visual  simulation,  (sdw) 
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ACOUSTIC  SIGNALS,  ANGLES,  AZIMUTH,  EARPHONES,  ELEVATION,  ESTIMATES, 

HEAD (ANATOMY) ,  MOTION,  PROTOTYPES,  RESPONSE,  STIMULI,  TARGETS 
PE62202F 

This  report  summarizes  three  studies  designed  to  measure  and  compare 
the  ability  of  subjects  to  localize  sounds  in  azimuth,  via  headphones, 
generated  by  two  prototype  auditory  localization  cue  synthesizers.  In 
the  first  study,  performance  differences  were  found  between  the  two 
synthesizers  in  certain  areas  of  the  azimuth  plane.  Additionally,  the 
design  of  a  synthesizer  (e.g.,  resolution  and  interpolating  between 
head-related  transfer  functions  (HRTFs)  can  impact  the  perceived 
direction  of  the  acoustic  signals.  Previous  research  with  directional 
audio  suggests  that  the  verdicality  of  3-D  auditory  displays  could  be 
optimized  if  individualized  HRTFs  are  employed  to  synthesize  the 
virtual  sound  sources,  particularly  in  elevation.  However,  data  from 
this  experiment  suggest  that  this  design  requirement  can  be  relaxed, 
especially  if  only  azimuth  information  is  to  be  conveyed  by  the 
localization  synthesizer.  In  the  second  study,  two  response  methods  for 
measuring  localization  performance  were  evaluated.  No  performance 
differences  were  found  when  subjects  either  verbally  reported  angular 
estimates  or  pointed  to  a  circle  to  indicate  the  perceived  direction  of 
the  target  stimuli.  In  the  third  study,  performance  was  impacted  by 
manipulating  the  bandwidth  of  the  acoustic  signal  and  head  movement. 
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AB  (27)  This  paper  presents  our  efforts  to  accurately  track  a  Head  Mounted 

Display  (HMD)  in  a  large  environment.  We  review  our  current  benchtop 
prototype  (introduced  in  (WCF90)),  then  describe  our  plans  for  building 
the  full-scale  system.  Both  systems  use  an  inside-out  optical  tracking 
scheme,  where  lateral-effect  photodiodes  mounted  on  the  user's  helmet 
view  flashing  infrared  beacons  placed  in  the  environment.  Church's 
method  uses  the  measured  2D  image  positions  and  the  known  3D  beacon^ 
locations  to  recover  the  3D  position  and  orientation  of  the  helmet  in 
real-time.  We  discuss  the  implementation  and  performance  of  the 
benchtop  prototype.  The  full-scale  system  design  includes  ceiling 
panels  that  hold  the  infrared  beacons  and  a  new  sensor  arrangement  of 
two  photodiodes  with  holographic  lenses.  In  the  full-scale  system,  the 
user  can  walk  almost  anywhere  under  the  grid  of  ceiling  panels,  making 
the  working  volume  nearly  as  large  as  the  room. 
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AB  (27)  The  virtual  cockpit  concept  being  developed  by  the  Air  Force  will 
require  a  helmet  mounted  eye  tracker  to  be  integrated  with  a 
helmet-mounted  virtual  panoramic  display  (VPD) .  Eye  tracker 
measurements  will  be  used  with  prototype  systems  to  assist  in  candidate 
display  evaluation.  Operationally,  eye  tracking  will  be  used  for  eye 
controlled  switch  selection,  cueing,  eye-slaved  aiming,  and  pilot  state 
monitoring.  Current  eye  tracking  technology  is  reviewed  in  Volume  I  of 
this  report.  Relevant  physiological  considerations  and  the  performance 
requirements  implied  by  each  of  the  above  VPD  tasks  are  thoroughly 
reviewed  in  Volume  II.  A  pupil  center-to-corneal  reflex  technique  is 
proposed  as  the  most  suitable  technique  for  a  VPD  eye  tracker.  The  need 
for  robustness  and  dependability  in  the  virtual  cockpit  Eye  movements, 
Oculometers,  Man-computer  interface.  Helmet-mounted  displays. 
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TEST  AND  EVALUATION,  CONTROL,  REQUIREMENTS,  DIGITAL  SYSTEMS, 
MEASUREMENT,  OPTICS,  AIR  FORCE,  MONITORING,  PERFORMANCE ( ENGINEERING ) , 
PILOTS,  PATHS,  TRACKING,  PROTOTYPES,  PROCESSING  EQUIPMENT,  DISPLAY 
SYSTEMS,  MOUNTS,  EYE,  SELECTION,  SWITCHES,  HELMETS 
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AB  (27)  The  virtual  cockpit  concept  being  developed  by  the  Air  Force  will 
require  a  helmet  mounted  eye  tracker  to  be  integrated  with  a 
helmet-mounted  virtual  panoramic  display  (VPD) .  Eye  tracker 
measurements  will  be  used  with  prototype  systems  to  assist  in  candidate 
display  evaluation.  Operationally,  eye  tracking  will  be  used  for  eye 
controlled  switch  selection,  cueing,  eye-slaved  aiming,  and'  pilot  state 
monitoring.  Current  eye  tracking  technology  is  reviewed  in  Volume  I  of 
this  report.  Relevant  physiological  considerations  and  the  performance 
requirements  implied  by  each  of  the  above  VPD  tasks  are  thoroughly 
reviewed  in  Volume  II.  A  pupil  center-to-corneal  reflex  technique  is 
proposed  as  the  most  suitable  technique  for  a  VPD  eye  tracker.  The  need 
for  robustness  and  dependability  in  the  virtual  cockpit  application  can 
best  be  met  by  using  a  full  two-dimensional  solid  state  array  detector 
and  a  system  that  makes  the  complete  image  available  to  a  digital 
processor.  Performance  goals  have  been  proposed  that  are  feasible  and 
will  satisfy  the  virtual  cockpit  task  requirements.  An  eye  tracker 
design  approach  and  prototype  development  plan  have  been  outlined  to 
meet  these  goals,  including  as  examples,  an  analysis  of  possible 
optical  paths  for  integration  with  the  off-aperture  and  dual-mirror  VPD 
designs . 
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AB  (27)  This  effort  researches  existing  Helmet  Mounted  Display  (HMD)  systems 
and  presents  a  prototype  design  of  a  color  Helmet-Mounted  Virtual 
Environment  Display  System.  Many  existing  systems  are  discussed, 
including  systems  currently  in  use  by  the  US  Navy,  Air  Force,  and  Army. 
Several  differing  designs  are  presented  and  evaluated.  The  Air  Force 
Institute  of  Technology  Helmet  Mounted  Virtual  Environment  Display 
System  places  the  user  in  an  visual  situation  that  is  generated  by  a 
computer.  This  HMD  system  could  easily  be  adapted  for  use  with  a  video 
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camera.  This  paper  presents  an  inexpensive  system  design  that 
incorporates  the  benefits  of  other  efforts.  The  cost  trade  offs  are 
evaluated  and  the  best  design  for  the  lowest  cost  is  presented.  The 
optics,  three  dimensional  considerations,  the  mounting  platform  and 
display  technologies  are  also  discussed.  The  final  HMD  system  design  is 
described  in  detail  and  presented  so  that  any  reader  could  build  a 
similar  system  for  minimal  cost.  This  system  uses  color  Liquid  Crystal 
Displays  (LCD)  mounted  directly  before  the  eyes  of  the  user.  Specially 
designed  optics  were  developed  to  enable  the  user  to  focus  on  the  image 
only  inches  away.  The  positional  information  of  the  user  is  determined 
by  a  sensitive  electro-magnetic  device  developed  by  Polhemus 
Navigational  Sciences .  This  system  is  very  accurate  but  has  a  limited 
effective  range.  Predictive  tracking  is  discussed  and  implemented  using 
a  simple  Kalman  filter  equation.  Theses. 
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*OCULOMETERS,  *HELMET  MOUNTED  DISPLAYS,  ^STIMULATION ( PHYSIOLOGY) 
AIRCRAFT,  BEHAVIOR,  COMMERCE,  COMPUTER  PROGRAMS,  CONTRACTS,  CYCLES, 
DEMONSTRATIONS,  DETECTORS,  DIAMETERS,  ENGINEERING,  EYE,  FLIGHT  TESTING, 
FORMATS,  HELMETS,  HISTORY,  HUMAN  FACTORS  ENGINEERING,  IMAGE  PROCESSING, 
INFLIGHT,  LABORATORIES,  LOW  COSTS,  PRODUCTION,  PROTOTYPES, 

SETTING ( ADJUSTING ) ,  SIMPLIFICATION,  TEST  AND  EVALUATION,  TEST 
EQUIPMENT,  TIME,  VISUAL  PERCEPTION 
*Eye  blink 

This  report  documents  Phase  I  of  a  Small  Business  Innovation  Research 
(SBIR)  contract  for  development  of  a  low-cost  helmet  mounted  eye  gaze 
point  sensor.  The  device,  in  completed  form,  is  for  use  in  laboratory, 
simulator,  and  in-flight  studies  by  NAVAIRTESTCEN  in  aircraft  test  and 
evaluation  projects.  Numerous  other  potential  applications  in 
behavioral  research  and  development  would  benefit  from  use  of  the 
device  produces  a  time  history  of  eye  gaze  point  information  along  with 
pupil  diameter  and  eye-blink  data.  It  has  flexibility  as  a  sensor 
system  for  many  different  modes  of  application.  Sentient  Systems 
Technology,  Incorporated,  completed  design,  testing,  prototype  hardware 
and  software  development,  and  functional  testing  of  a  prototype  unit. 
The  effort  constituted  a  full  feasibility  demonstration  in  the 
multistage  SBIR  contract  cycle  format.  Success  in  Phase  I  is  intended 
to  lead  to  follow-on  contracts  for  engineering  development  and 
applications  development  or  production  during  Phases  II  and  III. 
Functional  demonstrations  of  the  prototype  unit  with  Sun  Microsystems 
computer  equipment  were  convincing  and  fully  successful.  A  complete 
prototype  with  simplified  software  for  operation  with  an  IBM  compatible 
PC  system  is  now  being  evaluated  for  in-house  applications  in  a 
behavioral  test  and  evaluation  laboratory  setting.  Keywords:  Behavioral 
test  equipment.  Eye  blink  sensor.  Flight  test  equipment.  Gaze  point 
sensor.  Helmet  mounted  oculometer.  Human  factors  engineering.  Visual 
processing. 
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AB  (27)  This  report  details  the  continuing  development  of  a  fiber  optic 

coupled,  helmet  mounted  display.  A  prototype  model  has  been  developed. 

A  new  optical  design  results  in  lower  mass  on  the  helmet  and  simplicity 
of  alignment.  Techniques  for  substantially  reducing  fiber  optic  bundle 
mass  and  stiffness  are  explored.  A  dedicated  customized  helmet  has  been 
designed  and  produced  offering  a  low  weight  on  the  head  while 
maintaining  the  rigidity  necessary  for  good  optical  performance. 

Further  developments  in  head  position  and  the  use  of  accelerometers  for 
lead  prediction  are  described.  Techniques  for  blending  inset  and 
background  images  have  been  developed.  Studies  have  been  conducted  to 
validate  and  optimize  display  performance.  A  development  program  to 
produce  a  breadboard  helmet  mounted  eye  tracker  is  in  progress. 
Requirements  for  a  fully  eye  slaved  system  are  addressed.  Keywords: 
Computer  generated  imagery;  Helmet  position  sensing;  Infinity  display; 
Visual  simulation. 
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AB  (27)  Recent  developments  and  experiences  have  proven  the  usefulness  and 

potential  of  Unmanned  Vehicles  (UVs) .  Emerging  technologies  enable  new 
missions,  broadening  the  applicability  of  UVs  from  simple  remote  spies 
towards  unmanned  combat  vehicles  carrying  lethal  weapons.  However, 
despite  the  emerging  technology,  unmanned  does  not  implicate  that  there 
is  no  operator  involved.  Humans  still  excel  in  certain  tasks,  e.g. 
tasks  requiring  high  flexibility  or  tasks  that  involve  pattern 
perception,  and  decision  making.  An  important  subsystem  in  which  the 
technology  driven  aspects  and  the  human  factors  driven  aspects  of  UVs 
meet  is  in  the  data-link  between  the  remote  vehicle  and  the  operator. 
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The  human  factors  engineer  wants  to  optimize  operator  performance, 
which  may  require  a  data-link  with  an  extremely  large  capacity,  while 
other  design  criteria  typically  limit  the  bandwidth  (e.g.  to  lower 
costs,  or  because  no  more  bandwidth  is  available  in  certain 
situations) .  This  field  of  tension  is  the  subject  of  the  present  paper. 
The  paper  describes  two  human  factors  approaches  that  may  help  to 
resolve  this  field  of  tension.  The  first  approach  is  to  reduce 
data-link  requirements  (without  affecting  operator  performance)  by 
presenting  task-critical  information  only.  Omitting  information  that  is 
not  needed  by  the  operator  to  perform  the  task  frees  capacity.  The 
second  approach  is  to  optimize  performance  by  developing  advanced 
interface  designs  which  present  task-critical  information  without 
additional  claims  on  the  data-link.  An  example  will  be  given  of  both 
approaches . 
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AB  (27)  SRI  International  is  currently  developing  a  prototype  remote 

telepresence  surgery  system,  for  the  Advanced  Research  Projects  Agency 
(ARPA) ,  that  will  bring  life-  saving  surgical  care  to  wounded  soldiers 
in  the  zone  of  combat.  Remote  surgery  also  has  potentially  important 
applications  in  civilian  medicine.  In  addition,  telepresence  will  fmd 
wide  medical  use  in  local  surgery,  in  endoscopic,  laparoscopic,  and 
microsurgery  applications.  Key  elements  of  the  telepresence  technology 
now  being  developed  for  ARPA,  including  the  telepresence  surgeon's 
workstation  (TSW)  and  associated  servo  control  systems,  will  have 
direct  application  to  these  areas  of  minimally  invasive  surgery.  The 
TSW  technology  will  also  fmd  use  in  surgical  training,  where  it  will 
provide  an  immersive  visual  and  haptic  interface  for  interaction  with 
computer-based  anatomical  models.  In  this  paper,  we  discuss  our  ongoing 
development  of  the  MEDFAST  telesurgery  system,  focusing  on  the  TSW 
man-machine  interface  and  its  associated  servo  control  electronics. 
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introduces  a  novel  human-machine  interface,  namely,  haptic  stimulation 
through  a  VT  suit  to  improve  military  personnel  performance.  The 
complete  vibrotactile  (VT)  suit  system  will  include  three  main 
components:  a  sensor  package  to  acquire  motion  and  orientation 
information,  a  control  computer  that  will  condition  and  convert  the 
sensor  information  into  output  drive  signals,  and  the  VT  suit  for  the 
test  pilots.  Design  solutions  for  a  navigation  sensor  package  to  be 
used  in  helicopter  hover  and  extravehicular  activity  (EVA)  environments 
is  currently  being  undertaken.  Integrating  an  Inertial  Navigation 
System  (INS)  with  the  Global  Positioning  System  (GPS)  has  provided 
numerous  benefits,  and  with  the  recent  advances  in  Kalman  filtering 
techniques,  the  number  continues  to  grow.  In  addition  to  increased 
navigation  accuracy  under  dynamic  conditions,  tracking  accuracy  has 
improved,  CPU  time  has  decreased  and  crew  workload  has  decreased.  The 
dual  IN/GP  system  has  already  proven  its  strength  in  a  variety  of 
capacities  such  as  helicopter  flight  path  control,  flight  path 
management,  flight  testing  and  helicopter  approach.  While  research 
efforts  continue  to  establish  a  portfolio  for  this  dual  system,  much  of 
the  present  attention  had  been  given  to  reducing  the  development  and 
acquisition  costs. 
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AB  (27)  This  Symposium  explored  the  use  of  three  of  man's  senses  (sight, 

hearing,  touch)  to  improve  the  man-machine  interface  in  the  cockpit. 

The  seven  sessions  included  Defined  Concepts  and  Design  Issues, 
Maintenance  for  Advanced  Cockpit  Systems,  Panoramic  and  Virtual 
Cockpits,  Helmet  Mounted  Displays,  Voice  Technology,  System  Concepts 
and  Design  Tools,  and  finally  Device  Technologies.  As  the  demands 
placed  upon  the  aircrew  by  the  modern  battlefield  continue  to  increase, 
this  Symposi\am  attempted  to  effectively  blend  the  technologies  is 
available  to  decrease  the  workloads . 
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ways  that  significantly  improve  operational  effectiveness.  Many 
critical  systems  are  interactive,  and  the  ability  of  user  to  interact 
with  such  systems  could  be  improved  by  the  addition  of  spoken  language 
interfaces  to  facilitate  human/machine  interaction,  increase 
productivity,  and  reduce  training  time.  Our  goals  are  to  develop  usable 
SLSs  that  exhibit  the  following  advances:  (1)  at  least  an  order  of 
magnitude  increase  in  speed,  with  higher  accuracy;  (2)  a  four-fold 
reduction  in  the  overall  understanding  error  rate;  (3)  a  vocabulary  of 
up  to  10,000  words;  (4)  a  highly  interactive  user  interface  capable  of 
mixed  initiative;  dialogue,  system  feedback,  and  user  corrections  and 
additions;  (5)  a  flexible  system  capable  of  transparently  adapting  to  a 
new  user;  (6)  a  modular  system  easily  portable  to  new  applications  and 
sites;  and  (7)  a  system  implementable  in  real-time  on  COTS  hardware. 
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A  cockpit  is  mans  workshop  and  the  only  interface  with  a  machine 
(aircraft)  .  Without  considering  such  concepts  as  ergonomics  or  human 
engineering  it  is  understood  that  it  depends  on  the  cockpit  to  make  the 
most  of  the  capability  of  an  airframe  and  a  pilot. 
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The  increasing  availability  and  use  of  advanced  high  tech  human  machine 
interfaces  raise  many  interesting  questions  about  what  information 
should  be  presented  to  each  sensory  modality  and  how  the  information 
should  be  coded  for  a  given  modality.  In  this  paper,  attention  is 
confined  to  the  auditory  component  of  the  interface  and,  more 
specifically,  to  auditory  localization.  Both  teleoperator  systems  and 
virtual -environment  systems  are  considered,  and  attention  is  focused 
upon  the  opportunities  and  difficulties  associated  with  the  use  of 
unnatural  perceptual  cues  in  these  systems.  Of  central  interest  in  this 
discussion  is  the  use  of  such  cues  to  improve  resolution  and  thereby 
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obtain  systems  with  superlocalization  capabilities.  Advances  in 
technology  are  creating  major  new  challenges  in  the  area  of  human 
machine  interfaces  and,  in  particular,  the  design  of  interfaces  for 
teleoperator  systems  and  virtual  environment  systems .  In  a  teleoperator 
system,  the  human  operator  senses  and  operates  upon  a  remote, 
inaccessible,  or  hazardous  environment  by  means  of  a  slave  robot. 
Signals  in  the  environment  of  the  robot  are  sensed  by  devices  on  the 
robot,  communicated  back  to  the  teleoperator  interface,  and  displayed 
to  the  human  operator;  the  responses  of  the  human  operator  are  sensed 
by  devices  at  the  interface,  are  communicated  back  to  the  robot,  and 
are  used  to  control  the  actions  of  the  robot. 
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AB  (27)  As  more  and  more  machine  intelligence  is  built  into  the  interactive 
software  tools  of  the  future,  the  more  the  human- computer "dialogue " 
may  come  to  resemble  a  true  human-human  dialogue,  each  party 
anticipating  information  needed  by  the  other  and  avoiding  rigid, 
repetitive  or  overly  detailed  exchanges  by  assuming  the  existence  of  a 
body  of  shared  contextual  knowledge.  Although  to  hiamans  dialogue  means 
primarily  natural  language  (NL)  communication,  friendly  and  effective 
human- computer  dialogue  should  be  able  to  take  full  advantage  of  an 
integrated  mix  of  several  different  interaction  modes  including 
keyboard,  speech,  graphics,  and  body  gestures.  Context  tracking  would 
allow  each  input  or  output  transaction  to  be  minimally  specific, 
deriving  its  full  interpretation  from  background  information  relevant 
to  the  current  topic  of  the  interchange.  The  U.S.  Navy  has  a 
particular  interest  in  developing  advanced  user  interfaces  to  such 
interactive  knowledge -based  tools  as  decision  support  systems,  expert 
systems,  and  training  aids.  As  a  testbed  for  an  initial  investigation 
of  integrated  NL/graphical  interfaces  to  such  systems,  we  have  been 
working  for  about  a  year  now  with  a  simulation-based  test  planning  tool 
developed  by  Los  Alamos  National  Laboratory  for  the  Naval  Air  Systems 
Command.  (KAR)  P.  2 
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AB  (27)  A  Wessex  helicopter  at  RAE  Bedford  has  been  used  to  develop  and 

evaluate  a  set  of  electronic  cockpit  displays  and  a  comprehensive  suite 
of  avionics  which  were  integrated  to  form  an  advanced  display  and 
flight  management  system  for  both  military  and  civil  applications.  Two 
important  features  of  the  system  were  automatic  speech  recognition  and 
synthetic  speech  output.  Flight  trials  have  been  conducted  to  determine 
the  ground  rules  and  principles  pertinent  to  the  successful  integration 
of  these  devices  with  other  advanced  avionics.  The  trial  has  shown  that 
the  combination  of  speech  recognition  and  synthetic  voice  systems 
offers  an  element  of  redundancy  and  if  correctly  integrated  into  the 
cockpit  will  be  capable  of  improving  the  man  machine  interface  to  a  far 
greater  degree  than  is  achievable  by  hand  or  voice  alone.  (Author) 
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AB  (27)  A  Wessex  helicopter  at  RAE  Bedford  was  used  to  develop  and  evaluate  an 

integrated  avionics  system  which  incorporated  advanced  displays  and  a 

flight  management  system  for  both  military  and  civil  applications.  Two 
important  features  of  the  system  were  automatic  speech  recognition  and 
synthetic  speech  output.  Flight  trials  have  been  conducted  to  establish 
guidelines  for  the  successful  integration  of  these  devices  with 
advanced  avionics  such  as  colour  displays,  digital  maps  and  touch 
overlays.  The  use  of  speech  technology  in  the  cockpit  offers  an  element 
of  redundancy  and  if  correctly  integrated  will  be  capable  of  improving 
the  man  machine  interface  to  a  far  greater  degree  than  is  achievable  by 
hand  or  voice  alone.  The  trial  has  shown  that  data  input  and  retrieval 
from  such  a  well  structured  cockpit  management  system  can  be  achieved 
quickly,  simply  and  easily.  Keywords:  Speech  recognition;  Flight 
evaluation;  DVI .  Speech  output;  Advanced  Avionics;  Helicopters;  Great 
Britain. 
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AB  {21)  These  Proceedings  consist  of  the  papers  and  discussions  presented  at 
the  Avionics  Panel  Meeting  on  'Advanced  Avionics  and  the  Military- 
Aircraft  Man/Machine  Interface'  held  in  Blackpool,  England,  26-29  April 
1982.  The  30  papers  presented  were  divided  as  follows:  three  were 
introductory,  5  were  on  Colour  Display  Systems,  9  were  on  Voice  Input 
and  Output  Systems,  6  were  on  Aircrew  Interaction  with  Complex  Systems, 
and  7  were  on  Display  Technology.  The  Proceedings  also  include  a 
Technical  Evaluation  Report  of  the  Meeting.  (Author) 


C-47 


About  Human  Systems  lAC 


The  Human  Systems  Information  Analysis  Center  (Human  Systems  lAC,  HSIAC)  is  the  gateway  to 
worldwide  sources  of  up-to-date  human  factors  and  ergonomics  information  and  technologies  for 
designers,  engineers,  researchers,  and  human  factors  specialists.  Human  Systems  lAC  provides  a  variety  of 
products  and  services  to  government,  industry,  and  academia  while  promoting  the  use  of  human  factors 
and  ergonomics  in  the  design  of  human-operated  equipment  and  systems. 

Human  Systems  lAC’s  primary  objective  is  to  acquire,  analyze,  and  disseminate  timely  information  on 
human  factors  and  ergonomics.  In  addition  to  providing  free  basic  searches,  Human  Systems  lAC 
performs  other  services  on  a  cost-recovery  basis: 

•  Distribute  human  factors  and  ergonomics  technologies  and  publications 

•  Perform  customized  bibliographic  searches  and  literature  reviews 

•  Prepare  state-of-the-art  reports  and  critical  review 

•  Conduct  specialized  analyses  and  evaluations 

•  Organize  and  conduct  workshops  and  conferences 

Human  Systems  lAC  is  a  Department  of  Defense  Information  Analysis  Center  sponsored  by  the  Defense 
Technical  Information  Center.  It  is  technically  managed  by  the  Air  Force  Research  Laboratory  Human 
Effectiveness  Directorate  and  operated  by  Booz  Allen  &  Hamilton  Inc. 


Published  by: 


The  Human  Systems  Information  Analysis  Center  (HSIAC) 

ARFL/HEC/HSIAC 

2261  Monahan  Way,  Bldg.  196 

Wright-Patterson  AFB,  OH  45433-7022 

Phone:  (937)255-4842  DSN:  785-4842 

Fax:  (937)255-4823  DSN:  785-4823 


E-mail: 

WWW: 


